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This  report  is  one  of  a  series  on  the  research  support  provided 
by  the  Mellonics  Systems  Development  Division  of  Litton  Systems,  Inc., 
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rated  into  that  report  by  reference. 

As  set  forth  in  the  Contract  Statement  of  Work,  the  Mellonics 
effort  includes  support  to  the  Training  Extension  Course  (TEC) 
studies  presently  being  conducted  by  the  ARl.  One  of  these  studies 
involves  the  development  of  a  TEC  manager's  guide.  This  guide 
provides  general  guidelines  for  TEC  managers  and  lesson  developers, 
and  should  be  a  useful  reference  source  during  TEC  lesson  develop¬ 
ment.  It  also  serves  as  a  training  aid  for  new  managers  and 
developers . 
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ABSTRACT 


This  Guidebook  is  a  job  performance  aid  for  Training  Extension 
Course  (TEC)  managers  and  developers.  As  a  source  reference  it 
provides  information  on  the  organization,  management,  and  super¬ 
vision  of  a  TEC  program,  and  the  preparation,  development,  validation, 
and  dissemination  of  TEC  lessons.  For  other  personnel  involved  with 
TEC,  the  Guidebook  serves  as  a  comprehensive  overview  of  the  TEC 
development  process. 
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Purpose 

The  Training  Extension  Course  (TEC)  Manager  has  two  areas  of  responsi- 
bility.  The  first  comprises  organizing,  managing,  and  supervising  a  TEC 
program.  The  exact  nature  of  these  functions  will  vary  from  school  to 
school  because  of  different  school  organization  and  different  types  of 
internal  constraints.  The  second  area  is  more  consistant  across  schools, 
hese  functions  cover  the  preparation,  development,  validation,  and 
dissemination  of  TEC  lessons.  In  addition,  there  existed  no  single, 
easily  accessible  source  of  info-mation  to  assist  TEC  managers  and  lesson 
developers  in  the  development  of  TEC  lessons.  Thus,  the  purpose  of  this 
Guidebook  is  to  provjde  in  one  document,  general  guidelines  for  TEC 
managers  and  lessop  developers  to  be  used  as  a  source  reference  during 
the  TEC  lesson  development  process  and  to  serve  as  a  training  aid  for  new 
managers  and  developers.  The  Guidebook  can  also  serve  as  a  reference  for 
TEC  project  officers  at  the  Army  Training  Support  Center,  Training  Programs 
Directorate  (ATSC-TPD),  as  well  as,  other  personnel  who  are  i  nvol  ved  w  i  th 
TEC.  (e.-*).- >  some  sections  of  the  Guidebook  may  be  useful  to  contractors  for 
defining  criteria  and  developmental  procedures). 


Scope 

The  Guidebook  is  designed  to  be  used  as  both  an  information  document  for 
monitoring  contractor  lesson  development  efforts  and  a  procedural  guide  for 
designing  and  developing  TEC  lessons  in  house,  within  t he  existing 

resources  of  the  school.  The  Guidebook  provides  an  introduction  to  managers 
and  lesson  developers  for  the  tasks  and  procedures  that  have  to  be  considered 
when  a  TEC  lesson  js  under  development.  It  wi 1 1  not  eliminate  the  need  for 
other  resources,  such  as,  changes  to  contract  statements  of  work  (SOW).  It  is 
not  a  fully  procedural i zed  job  performance  aid  and  does  not  list  s t^p-by-s tep 
procedures  for  all  decision  alternatives.  Rather,  it  introduces  the  TEC 
program  and  general  TEC  management  techniques.  It  also  gives  examples  and 
guidelines  for  developing  and  evaluating  TEC  lesson  criteria. 


Contents 

The  Guidebook  is  divided  into  six  chapters,  followed  by  a  glossary  and  on 
acronym  list. 

Chapter  1  provides  introductory  material  on  TEC  organization;  relation¬ 
ships  between  the  schools,  the  ATSC-TPD,  trie  Project  Manager  for  Training 
Devices  (PM  TRADE),  and  the  Naval  Training  Equipment  Center  (NTEC)  ;  arid 
responsibilities  and  training  opportunities  for  TEC  managers. 

Chapter  2  presents  material  related  to  systematic  approaches  to  course 
development;  relationships  between  TEC,  the  Instructional  Systems  Development 


vi  i 


VP  (IS D)  model,  and  Directorates  of  Training  Development  (DTD);  planning  require¬ 

ments  and  techniques;  use  of  Subject  Matter  Experts  (SME) ;  and  recurring 
report  requirements. 

Chapter  3  discusses  the  requirements  for  preparation  for  TEC  lesson  devel¬ 
opment.  This  includes  an  overview  of  the  basic  principles,  preparation  tech¬ 
niques  and  procedures  for  TEC  lesson  development,  how  to  select  media,  how 
to  write  the  Coordination  and  Contract  Summary  Sheet  (CCSS) ,  and  how  to  write 
Lesson  Administrative  Instructions  (LAl)  and  Student  Instruction  Sheets  (SIS). 

Chapter  h  provides  human  factors  criteria  and  design  information  to 
assist  in  designing  and  monitoring  the  development  of  TEC  lessons.  Criteria 
are  discussed  for  application  to  both  development  and  evaluation  of  TEC 
lessons.  All  TEC  lesson  types  (audiovisual,  audio  only.,  printed  text,  and 
job  performance  aid)  are  discussed. 

Chapter  5  presents  a  detailed  discussion  of  the  TEC  manager's  job  in 
conducting  or  monitoring  the  TEC  evaluation  process.  It  includes  discussion 
of  how  to  validate  pre-  and  posttests  and  how  to  conduct  the  sequence  (cycle) 
of  tests  necessary  to  demonstrate  TEC  lesson  training  effectiveness. 

Chapter  6  discusses  the  requirements  on  the  TEC  manager  for  preparing 
the  final  TEC  materials  for  distribution  and  for  historical  storage  of  the 
data  and  materials.  It  also  describes  the  shipment  of  TEC  lessons  to  the 
Training  Materiel  Support  Detachment  at  Tobyhanna ,  TEC  lesson  annual 
review  procedures,  procedures  for  a  safety  violation,  and  safeguarding 
of  defense  information. 

How  to  Use  this  Guidebook 

This  Guidebook  is  designed  for  a  "thumbing  through"  approach. 

Descriptive  illustrations,  flow  charts,  high-lighted  material,  and 
subject  (leadings  are  placed  at  the  outer  portions  of  each  page  to 
permit  easy  location  when  thumbing  through  the  book,  from  cither 
direction.  "White  space"  is  contained  in  the  outer  columns  of  each 
page  for  each  user  to  write  his  or  her  own  personal  notes.  The  loose- 
leaf  format  allows  information  to  be  added  as  TEC  policies  and  require¬ 
ments  change,  and  permits  each  user  to  tailor  the  Guidebook  to  their 
school's  organization. 
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1.0  ORGANIZATION  AND  MANAGEMENT  OF 
A  TEC  DEVELOPMENT  UNIT 


This  chapter  serves  as  an  introduction 
to  the  Training  Extension  Courses  (TEC). 

It  provides  you  with  information  on 
TEC  organization  and  management. 
Relationships  between  the  Service 
Schools,  the  Army  Training  Support 
Center  -  Training  Programs  Direc¬ 
torate  (ATSC/TpD),  the  Project  Manager 
for  training  Devices  (PM  TRADE),  and 
the  Naval  Training  Equipment  Center 
(NTEp)  are  discussed,  included  also, 
are  the  responsibilities  of  and  train¬ 
ing  opportunities  for  TEC  managers. 


ORGANIZATION  AND  MANAGEMENT 
OF  A  TEC  DEVELOPMENT  UNIT 

•  TEC  HISTORY  AND 

PHILOSOPHY 

•  ORGANIZATION  OF  TEC 

•  SCHOOLS,  ATSC/TPD,  PM 

TRADE,  NTEC,  AND  CONTRAC¬ 
TOR  RELATIONSHIPS 

•  TEC  MANAGERS'  RESPONSI¬ 

BILITIES  AND  TRAINING 
OPPORTUNITIES 


1.1  INTRODUCTION  TO  TEC  HISTORY, 

PHILOSOPHY,  AND  ACCOMPLISHMENTS 


In  order  to  help  you  understand 
the  background  and  purpose  of  TEC, 
this  section  includes  information 
about  the  history  of  TEC,  its  phil¬ 
osophy,  and  its  relationship  to  other 
Army  training  programs. 
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The  success  of  the  Training 
Extension  Course  (TEC)  depends  on 
you.  An  old  cliche?  Maybe,  but 
nevertheless  true.  The  success  of 
TEC  depends  upon  more  than  just 
having  a  TEC  manager  at  each 
school  to  supervise  the  legal  ful¬ 
fillment  of  the  contractual  require¬ 
ments.  The  TEC  program  is  relative¬ 
ly  new,  and  even  though  its  success 
is  steadily  mounting,  there  are 
many  service  schools  and  field 
commanders  who  are  not  taking  full 
advantage  of  TEC.  Thus,  the  program 
still  needs  to  be  sold.  The  best 
way  to  promote  TEC  is  to  have  moti¬ 
vated  TEC  managers  who  know  the 
training  philosophy,  the  develop¬ 
ment  process,  and  the  management 
aspects  of  TEC;  who  believe  in  it; 
and  who  capitalize  on  every  oppor¬ 
tunity  to  sell  TEC  to  units  and  to 
resident  instructors.  This  guide¬ 
book  is  aimed  primarily  at  the  first 
of  these  three  characteristics: 
to  help  you  know  TEC.  This  resource 
is  provided  to  help  you  understand 
the  purpose,  background,  and  philo¬ 
sophy  of  TEC,  and  the  procedures  for 
managing  TEC,  but  that  is  as  far  as 
we  can  go  with  a  book. 

We  have  found  that  the  second 
characteristic,  the  belief  in  TEC, 
comes  from  experience  with  TEC. 

The  program  speaks  for  itself. 

After  trainers,  commanders,  and 
trainees  are  exposed  to  it  and  try 
it,  they  are  impressed.  This  fact 
supports  the  importance  of  the 
third  characteristic  of  the  dedicated 
TEC  manager.  By  recognizing  oppor¬ 
tunities  to  expose  people  to  TEC  and 
showing  them  how  to  organize  so  it 
wi ) 1  support  their  training,  you 
will  be  providing  the  program  with 
the  opportunity  to  "sell  itself". 


Accordingly,  this  section  of  the 
guidebook. Is  aimed  at  helping  you  sell 
TEC.  It  provides  you  with  background 
knowledge  on  the  history,  philosophy, 
purpose,  and  effectiveness  of  TEC. 
Hopefully,  It  will  be  motivating,  in¬ 
formative,  and  useful  in  helping  you 
become  an  effective  representative 
of  TEC.  Subsequent  sections  and 
chapters  will  present  recommendations 
and  techniques  to  help  you  become  more 
proficient  in  the  procedures  required 
to  manage  TEC. 

1.1.2  What  is  TEC? 

TEC  is  a  program  that  has  been 
designed  to  help  put  into  the  hands  of 
trainers,  both  in  units  and  in  insti¬ 
tutions,  exportable,  performance- 
oriented  training  packages.  It  is 
designed  to  provide  soldiers  and  their 
commanders  with  immediate  access  to 
high  quality,  self-paced,  multimedia 
instruction  especjally  designed  to 
assist  In  acquiring  and  maintaining 
skills  critical  to  the  soldier's 
1  on-the-job  performance.  Each  TEC 
lesson  is  Individually  packaged,  and 
ready  for  use  on  qn  individual  basis, 
or  by  small  groups,  under  the  super¬ 
vision  of  an  NCO. 

1.1.3  Reasons  for  TEC 

i 

Historically,  TEC  began  in  the 
early  1970's  as  a  response  to  a  number 
of  problems  in  individual  training. 

The  most  serious  of  these  was  detected 
by  the  U.  S.  Army  Board  For  Dynamic 
Training.  They  found  that  many  sol¬ 
diers  In  combat  arms  units  were  not 
able  to  perform  critical  tasks  in  their 
primary  Military  Occupational  Specialty 
(MOS) .  This  lack  of  competency  on 
the  part  of  individuals  can  quickly 
mushroom  and  destroy  a  unit's  combat 
capability.  In  the  process  of  consi¬ 
dering  solutions  to  this  problem, 
many  other  problems  were  uncovered 
that  confront  commanders,  training 
managers,  and  trainers.  Some  of  these 
problems  were: 
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•  Insufficient  numbers  of 
qualified  NCOs  to  conduct 
the  required  training. 

•  Demands  on  the  commander's 
time  which  interferred  with 
training  time. 

•  Personnel  turbulence  such 

as  frequent  turnover  and  low 
manning  levels. 

•  Rapidly  changing  doctrine 
which  necessitates  changes 
in  training. 

•  Limited  training  resources 
such  as  the  shortage  of  time, 
personnel ,  and  space  to  pro¬ 
vide  sufficient  field-based 
training. 

All  of  these  problems  underscored 
the  need  for  a  system  of  exportable 
training  support  that  would  make  per¬ 
formance  based,  high  quality  instructio- 
available  to  field  units  in  an  easy  to 
use  format.  TEC  was  conceived  as 
such  a  system. 

1 . 1  .  *4  Characteristics  of  TEC 


TEC  FEATURES  TEC  training  materials  are 

designed  to  emphasize  performance  -- 
what  the  soldier  will  do  as  a  result 
of  the  training.  The  training  is 

•  SELF-PACING  developed  and  validated  to  insure 

that  the  soldier  will,  in  fact,  be  able 

•  LESSON  ADMINISTRATIVE  INSTRUCTIONS  to  perform  the  task  after  the  comple¬ 

tion  of  training.  TEC  lessons  have 

•  DIAGNOSTIC  TEST  (PRETEST)  incorporated  the  following  features: 


•  SELF- PACING 


•  DIAGNOSTIC  TEST  (PRETEST) 

•  VALIDATED  CONTENT 

•  INDIVIDUAL  OR  GROUP  INSTRUCTION 

•  MULTIMEDIA  DELIVERY 


Self-pacing:  A  soldier 
can  work  through  a  lesson 
individually  at  his  own 
pace.  He  can  repeat  the 
lesson  as  often  as  necessary 
until  he  achieves  mastery. 


; 


•  Lesson  Administrative  Instruc¬ 
tions  (LAI)  are  provided  with 
each  lesson.  They  provide 
guidance  for  the  trainer  on 
how  to  use  the  training  system 
to  Identify  and  solve  individual 
training  deficiencies. 

•  Diagnostic  test  (pretest): 

This  test  can  be  used  with 
individuals  to  determine 
whether  they  need  to  study 

a  given  lessor),  and  it  can  be 
administered  by  a  commander 
to  his  soldiers  to  assess  their 
job  proficiency.  It  is  the 
first  step  jn  the  management 
of  training. 

•  Validated  content:  During  the 
development  phase,  each  TEC 
lesson  is  tested  on  soldiers  in 
units  to  verify  that  it  will 
teach. 

•  Individual  or  group  instruction: 
Many  of  the  lessons  can  be  used 
by  as  many  as  ten  soldiers  at 
once,  and  all  of  the  lessons 
can  be  used  individually. 

•  Multimedia  delivery:  TEC 
lessons  are  currently  produced 
in  a  variety  of  modes  (audio¬ 
visual,  audio  only,  printed 
text,  and  job  performance  aids) 
depending  upon  which  is  most 
appropriate  for  the  objectives 
of  a  given  lesson. 

I 

1.1.5  Philosophies  of  TF.C 

TEC  is  most  effective  when  the  people 
using  TEC  understand  certain  philosophical 
and  scientific  assumptions  that  form  the 
background  of  th|s  program.  Educational 
psychologists  have  proven  that  better 
learning  usually  occurs  when  the  learner 
makes  frequent,  active  responses,  few 
errors,  and  receives  feedback  on  his 
performance.  Furthermore,  retention 
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e  RECEIVES  FEEDBACK 


\y 

‘ 


1-7 


and  transfer  of  learning  are 
better  if  the  training  situation 
closely  simulates  the  actual 
performance  situation,  end  the 
learner  has  opportunities  to 
practice  what  he  has  learned. 

These  principles  are  operating  in 
the  following  statements  that 
characterize  the  philosophy  of 
TEC: 

•  Learning  is  a  self-activ¬ 
ity.  Numerous  studies  have 
demonstrated  that  students 
learn  faster,  retain  longer 
and  have  a  higher  motivation 
when  they  control  their  rote 
of  progress  toward  training 
goa 1 s . 

•  Training  should  overcome 
a  performance  deficiency. 

Since  the  achievement  of 
specific  performance  objec¬ 
tives  is  what  we  are  after, 

no  training  need  be  undertaken 
if  the  soldier  can  already 
all  the  performance  objectives 
in  a  satisfactory  manner. 

•  Training  is  best  if  it 
closely  approximates  the  real 
world  condition.  When  the 
soldier  can  relate  the  tasks 
to  his  real  world  job  require¬ 
ments,  he  will  be  more  motiva¬ 
ted  and  will  learn  better. 

•  Soldiers  learn  and  retain 
more  If  they  participate 

In  the  training  rather  than 
merely  being  exposed.  Lesson 
materials  providing  "hands  on" 
training  are  the  most  effective 

•  Soldiers  would  rather  learn 
than  not  learn.  Most  soldiers 
strive  for  competency  and 
professionalism  in  their  chosen 
career.  The  key  is  to  devise 

a  management  system  to  make 
the  training  materials  avai 
able  and  job  relevant. 


1.1.6  Relationship  Between  TEC 
and  Total  Army  Training. 


TEC  and  To tat  TAaiiut tfl. 

The  current  concept  of  Army  train¬ 
ing  is  based  on  the  belief  that 
training  should  be: 


•  Exportable  so  that  it  is 
aval lable  where  it  is 
needed. 


•  Performance  based  so  that 
soldiers  are  learning  skills 
rather  than  just  knowledge. 


Validated  so  the  training 
can  be  proven  effective. 


Does  this  summary  sound  complete 
to  you?  In  fact,  there  is  one 
vital  element  that  was  left  out.  It 
is  the  question  of  whether  the 
training  is  worthwhi |e.  For  every 
lesson,  course,  and  training  guide¬ 
book  we  must  a$k,  'Ms  it  worthwhile?" 
The  answer  to  this  question  is  found 
by  answering  a  companion  question 
which- Is,  "Is  this  a  vital,  necessary 
skill  in  a  given  soldier's  job?" 

Every  school  in  the  Army  has  been 
required  to  answer  this  question 
for  their  proponent  military  occu¬ 
pational  specialties  (MOS) .  They 
have  conducted  task  analyses  in 
order  to  identify  the  critical 
tasks  in  each  MOS.  This  task  list, 
combjned  with  the  training  philosophy 
form  the  foundation  for  the  Army's 
training  program.  TEC,  along  with 
the  other  current  training  support 
activities,  is  built  upon  this  foun- 
dat i on; 
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TFC,  EPf.lS,  and  SOT.  TEC  i s  a 
vital  training  component  in  indivi¬ 
dual  training  under  the  Enlisted 
Personnel  Management  System  (EPMS) . 
This  system  brings  together,  for  the 
first  time,  j  S  requirements  and 
training  requirements  for  each  grade 
in  each  MOS.  These  requirements  are 
identified  in  the  Soldier's  Manual, 
and  proficiency  is  measured  by  a 
Skill  Qualification  Test  (SQT). 

TEC  is  designed  to  provide  training 
on  critical  tasks  that  are  defined 
in  the  Soldier's  Manual  and  might  be 
included  in  the  SQT. 


The  soldier  can  identify  those 
tasks  for  which  he  needs  to  achieve 
proficiency  by  reviewing  the  Soldier's 
Manual  and  taking  the  appropriate 
pretests.  He  can  then  use  the  avail¬ 
able  TEC  lessons  independently,  or 
in  conjunction  with  on-the-job  train¬ 
ing  (OJT) ,  to  develop  the  necessary 
skills.  As  a  TEC  manager,  it  is 
imperative  that  you  help  insure  that 
TEC  interlock  with  the  overall 
training  development  effprt  and  that 
trainers  in  units  and  in  the  schools 
understand  this  relationship. 

TEC  and  ARTEP.  The  Army  Training 
and  Evaluation  Program  (ARTEP)  is 
aimed  more  at  collective  training 
evaluation  and  proficiency,  while  SQT 
is  aimed  at  individual  training 
evaluation.  But  it  almost  goes  without 
saying,  v/el  1 -trained  units  require 
proficient  individuals.  Even  though 
TEC  is  designed  primarily  for  individual 
training,  it  is  a  valuable  tool  in 
assessing  and  improving  unit  readi¬ 
ness.  The  pretests  in  TEC  lessons 
can  be  quickly  and  easily  administered 
to  the  appropriate  MOS  soldiers  of  an 
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entire  unit  to  obtain  a  measure  of 
proficiency  in  critical  tasks. 

This  will  indicate  to  the  commander 
whether  his  troops  are  prepared  for 
collective  training  or  maneuvers. 

If  the  troops  are  not  up  to  stand¬ 
ards  on  key  skills,  the  necessary 
Individual  training  can  be  programmed 
before  collective  training  begins. 

One  of  the  big  advantages  of  TEC 
comes  into  play  at  this  point. 

Instead  of  taking  the  entire  unit 
through  a  series  of  platform 
lessons  and  field  demonstrations 
on  all  of  the  critical  tasks,  the 
trainjng  can  be  individualized. 
Soldiers  can  be  assigned  simul¬ 
taneously  to  different  lessons  in 
accordance  with  their  training 
needs.  What  is  more,  these  lessons 
are  performance-oriented  and 
validated.  The  end  result  should 
be  less  time  spent  in  training 
with  more  effective  standardized 
training.  The  bottom  line  for  the 
TEC  manager  is  the  same  as  it  was 
before  with  EPMS:  TEC  lessons 
should  interlock  with  the  overall 
training  development  effort. 

For  TEC,  together  with  the  other 
elements  of  individual  and  collec¬ 
tive  training,  is  part  of  the  pillars 
in  the  "Greek  Temple'!  illustration 
which  you  see  in  several  TEC  publi¬ 
cations.  This  illustration  captures 
the  essence  of  the  Army  Training 
philosophy.  it  shows  the  building 
block  approach  and  the  systematic 
interrelationships  between  philo¬ 
sophy,  tasks,  methods,  and  results. 
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1.1.7  TEC  and  Proficiency 

We  have  been  making  many  claims 
about  the  benefits  of  TEC,  but  what, 
you  may  wonder  is  the  evidence  that 
supports  these  claims.  There  are, 
in  general ,  two  types  of  evidence. 

The  first  is  internal;  it  is  the 
type  of  evidence  that  accumulates 
from  the  "built-in"  process  of  devel¬ 
oping  and  validating  TEC.  The  second 
type  is  external,  and  results  from 
external  agencies,  such  as  the  Army 
Research  Institute  for  the  Behavioral 
and  Social  Sciences,  conducting  eval¬ 
uations  of  TEC.  Altogether,  the  evidence 
acquired  so  far  is  too  massive  to 
Include  in  this  document,  but  we  can 
give  you  a  summary  of  the  types  of 
evidence,  and  the  general  results. 

Internal  Evidence.  The  strongest 
internal  evidence  is  obtained  during 
the  validation  process.  During  the 
development  phase,  each  lesson  is 
tried-out  on  an  appropriate  number  of 
soldiers  to  determine  whether  the 
lesson  teaches  what  it  is  supposed  to 
teach.  No  lesson  is  approved  for 
reproduction  and  distribution  unless 
it  meets  the  validation  standards 
established  by  the  proponent  school. 

It  the  tests  used  in  the  lesson  were 
validated,  and  appropriate  sampling 
procedures  were  followed,  then  the 
lesson  validation  process  provides 
strong  evidence  in  support  of  the  lesson. 
You  may  be  flattered  to  know  that  no 
other  organization  in  the  world  that 
even  approaches  the  size  of  the  U.  S. 

Army  is  using  such  a  systematic,  rigor¬ 
ous  approach  to  training  development. 
Additional  anecdotal  evidence  ,  although 
it  is  not  numerical,  is  continuously 
received  from  TEC  managers,  training 
commanders,  field  commanders,  and 
soldiers  who  have  experienced  the 
effectiveness  of  TEC.  This  is  also 
important  information  since  the  lessons 
have  to  be  wel 1 -recei ved  and  used  before 
they  can  be  effective. 
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ExXoAnal  Evidence.  External 
evidence  has  been  obtained  In  re¬ 
search  studies  conducted  by  the 
Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  (ARl). 
These  studies  tend  to  indicate  that 
TEC  is  effective  and  that  there  are 
several  benefits  to  be  derived  from 
the  program.  The  data  are  not  complete, 
there  are  several  studies  underway  as 
this,  guidebook  goes  to  press,  but  there 
appear  to  be  five  conclusions  that  can 
be  drawn  from  the  studies  so  far 


TEC  is  effective.  When 
soldiers  use  TEC,  they 
learn  from  it;  they  be¬ 
come  more  proficient 
soldiers.  Two  different 
studies  by  ARl  support 
this  conclusion. 


TEC  lessons,  when  properly 
developed  and  validated, 
will  do  a  better  job  than 
conventional  training. 

This  conclusion  has  pre¬ 
liminary  support  in  one  ARl 
study,  and  is  still  being 
studied.  When  TEC  is  com¬ 
bined  with  conventional 
training,  the  results  should| 
be  even  better. 
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TEC  cart  be  made  available 
where  other  forms  of  train¬ 
ing  are  not.  This  should 
improve  overal I  individual 
effectiveness,  and  a  study 
is  underway  to  help  answer 
this  question. 


TEC  offers  standardized, 
school  developed  and  vali¬ 
dated  instruction.  This 
standardization  helps  insure 
all  soldiers  will  receive 
the  same  high  quality  in¬ 
struction. 


When  TEC  is  substituted  for 
conventional  training, 
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training  development  and 
administrative  resources  can 
be  used  to  train  in  other 
areas.  (Some  TRADOC  schools 
are  doing  this  now!) 

•  TEC  has  been  positively 
received  by  field  units  and 
research  components.  ARI 
personnel  report  they  receive 
many  volunteered  comments  in 
support  of  TEC  as  they  conduct 
their  studies.  These  comments 
indicate  when  soldiers  and 
commanders  use  TEC,  they  like 
it  and  they  think  it  is  effect 

These  benefits  are  important,  not 
because  TEC  is  trying  to  compete  with 
other  training  alternatives,  but 
because  TEC  is  trying  to  fill  an 
important  need  in  the  Army  training. 

So  far,  the  indicators  of  TEC's 
ability  to  meet  this  need  are  "thumbs 
up",  and  this  success  can  be  attribute 
directly  to  the  motivation,  dedicatic 
a^d  capableness  of  TEC  managers  such 
as  yourself. 
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1.2  ORGANIZATION  OF  TEC 


Many  agencies  are  involved  in  the 
complete  TEC  process,  and  it  is  difficult 
to  represent  the  entire  network  on  paper. 
This  section  and  the  following  section 
describe  many  of  these  relationships. 
After  you  have  studied  these  sections, 
and  the  portions  of  the  manual  deal¬ 
ing  with  the  TEC  development  process, 
and  have  obtained  some  experience, 
you  will  become  familiar  with  the 
entire  process.  Your  understanding 
will  grow  most  rapidly  if  you  will 
reread  these  sections  from  time  to 
time  as  you  become  familiar  with  the 
various  agencies  involved. 


1.2.1.  Organization  of  TEC  at  ATSC 

The  U.S.  Army  Training  Support 
Center  (ATSC)  was  established  under 
the  Training  and  Doctrine  Command 
(TRADOC)  at  Fort  Eustis,  Virginia, 
on  1  July  1976.  Its  purpose  was  to 
harness  the  management  of  training 
support  activities  previously 
scattered  throughout  TRADOC.  Its 
stated  mission  required  ATSC  to 
provide  centralized  management 
of  training  support  activities 
for  individual  and  collective 
training  for  Active  Army  and 
Reserve  Component  forces. 

The  responsibility  still 
lies  with  the  schools  to  develop 
courseware  since  that  is  where 
the  subject  matter  experts  are 
located,  and  that  is  where  analysis 
and  identification  of  training 
needs  occur.  ATSC  provides  the 
interface  with  other  units  (see 
illustration)  that  is  necessary 
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in  the  process  of  developing  and 
distributing  exportable  training 
mater i a  1 s  . 


Operationally,  ATSC  is  organ¬ 
ized  with  a  small  staff,  and  six 
functional  directorates.  These 
directorates,  one  of  which  is  Train¬ 
ing  Piograms  Dictorate  (TPP)  have 
the  primary  operational  role  In 
exportable  training  support  materials. 
TPD  manages  the  programs  involving 
the  transmission  of  training  via 
selected  media.  Included  in  this 
area  are: 

•  Army  Training  Literature 
Program  --  encompasses  Soldier's 
Manuals,  Field  Manuals,  How  to 
Fight  Manuals,  and  Training 

Ci rculars. 

•  Training  Extension  Course  (TEC)  -- 
the  system  of  self-paced  vali¬ 
dated  instruction  utilizing  a 
variety  of  media  to  be  used  in 
Individual  or  small  group  instruc¬ 
tion. 


•  Television/Motion  Picture  Program  -- 
production  and  distribution  of 
over  4,000  subjects,  usually 
in  3/4- inch  tape  format. 


In  particular,  TEC  is  managed 
by  a  division  of  TPD,  the  Army 
Training  Extension  Course  Program 
(ATECP) .  ATECP  comprises  the 
four  subdivisions  shown  in  the 
wiring  d i agram. 
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There  is  a  great  variety  in  the 
way  TEC  units  are  organized  at  the  var¬ 
ious  schools.  This  statement  will 
come  as  no  surprise  to  the  exper¬ 
ienced  TEC  manager,  but  it  may  be 
helpful  to  the  newly  assigned  manager 
to  realize  that  this  diversity  exists. 
Therefore,  the  purpose  of  this  section 
is  simply  to  describe  the  extent  to 
which  schools  do  differ  In  the  way 
they  have  organized  TEC.  In  some 
schools,  such  as  the  Judge  Advocate 
General's  School,  TEC  is  developed 
on  a  limited  basis.  The  TEC  manager 
has  other  responsibilities  besides 
TEC.  In  other  schools,  such  as 
Infantry  or  Armor,  the  TEC  staff  is 
large  with  a  requirement  for  ten  or 
more  personnel.  It  is  normally  the 
case  that  the  TEC  Branch  is  located 
in  the  Course  Developrriont  Division, 
but  it  may  be  in  some  other  divis¬ 
ion  such  as  Training  and  Literature. 

The  TEC  Branches  also  differ  in  terms 
of  the  degree  of  centralization. 

Some  schools  have  a  centralized  TEC 
Branch  which  is  a  separate  enti ty, 
and  for  which  they  provide  resources. 

In  a  few  schools,  TEC  Is  decentral¬ 
ize^  in  that  it  is  not  singled  out 
as  a  separate  administrative  entity. 

In  these  schools  TEC  is  handled  con¬ 
currently  wjth  other  training 
development  responsibilities. 

The  point  being  made  here  is 
that  there  are  a  variety  of  means  by 
which  the  goals  of  TEC  are  accomp¬ 
lished.  The  important  thing  |s  for 
you  to  become  as  knowledgeable  as  you 
can  of  the  responsibilities  facing  you, 
of  the  different  means  of  accomplishing 
those  goals  that  have  been  discovered 
at  other  schools,  and  to  utilize  that 
knowledge  in  the  most  effective  way 
possible  at  your  school. 


1.3  RELATIONSHIPS  BETWEEN  THE  SCHOOLS 
PM  TRADE,  NTEC ,  AND  THE  CONTRACTOR' 


During  a  complete  cycle  of  a  TEC 
contract  development,  you  wi 1 1  inter¬ 
act  with  representatives  of  all  these 
agencies.  In  a  general  way,  each  of 
these  agencies  has  a  defined  responsi¬ 
bility.  However,  the  lines  of  communi¬ 
cation  and  specific  responsibilities 
do  not  stay  the  same.  They  change  during 
different  peases  of  the  contract  develop¬ 
ment.  Accordingly,  Section  1  3-1  ex¬ 
plains  the  general  responsibilities  of 
each  unit  in  order  to  clarify  the  purpose 
for  each.  Then  Section  1.3.2  illustrates 
appropriate  lines  of  communication  for 
each  phase  of  the  contract. 


1.3.1 _ Genera  1  Areas  of  Responsibility 

in  TE C_  Contracts 


SCHOOL  RESPONSIBILITIES 

•  SPECIFY  REQUIREMENTS 

•  PROVIDE  GFM 

•  REV  I  FI!  FOR  TECHNICAL  AND 

DOCTRINAL  ACCURACY 


The  Schoct.  Before  a  TEC  contract 
is  written,  each  school  to  be  included 
in  the  contract  is  asked  to  formulate 
a  set  of  requirements  for  major  sub¬ 
ject  areas  to  be  covered  and  the  number 
of  instructional  packages  (kits)  to  be 
developed.  These  requi  reinents  are  based 
on  the  school's  needs  and  the  guide¬ 
lines  provided  by  ArSC/TPL).  After  the 
requirements  have  been  approved,  the 
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school  will  prepare  government 
furn i shed  mater i a  Is  (GR1)  for  the 
contractor.  These  will  be  presented 
to  the  contractor  when  the  contract 
is  awarded,  normally  in  incremental 
deliveries.  After  the  contractor 
begins  to  develop  the  lessons,  the 
school  will  review  them  at  specified 
times  with  respect  to  technical  and 
doctrinal  accuracy.  The  school  will 
also  monitor  the  trial  and  validation 
process,  and  approve  the  8mm  answer 
print,  proofs  of  camera  ready  copy, 
or  answer  print  audio  tape  before 
the  mass  reproduction  phase  begins. 


A TSC/TPV.  The  U.S.  Army  Train¬ 
ing  Support  Center,  Training  Programs 
Directorate  (ATSC/TPD)  is  responsible 
for  establishing  priorities  for  the 
overall  TEC  program.  This  includes 
long  range  plans  for  the  rate  of  TEC 
lessons,  and  the  role  to  be  played  by 
TEC  in  the  total  Army  training  program. 

ATSC/TPD  provides  several  serv¬ 
ices  to  the  various  schools  partici¬ 
pating  ip  the  program.  They  work 
with  TRADOC  DCSRM  (Deputy  Chief  of 
Staff  Resource  Management)  in  pro¬ 
viding  the  funding  foi  the  contract, 
and  for  each  school's  TEC-related 
administrative  expenses  (minus  civilian 
salaries).  They  also  participate  with 
the  schools  in  the  planning  and  pro¬ 
gramming  of  lessons  for  development. 
Prior  to  the  contract  preparation 
phase,  the  ATSC/TPD  project  officer 
(PO)  assigned  to  the  fiscal  year 
program  will  coordinate  the  prepar¬ 
ation  of  contractual  requirements. 

These  requirements  will  be  forwarded 
to  Project  Manager  for  Training 
Devices  (PM  TRADE)  for  preparation 
of  a  contractual  package  that  ad¬ 
heres  to  the  user  requirements. 

After  the  contract  has  been  awarded, 
the  ATSC/TPD  PO  wi 1 i  monitor  the 
process  and  help  solve  problems 
as  they  occur  at  all  schools  covered 
by  that  contract.  The  ATSC/TPD  PO  is 
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PM  TRADE  RESPONSIBILITIES 

•  SUPERVISE  PROCUREMENT 

•  PROVIDE  COTR  IF  REQUIRED 

•  SUPERVISE  CONTRACT 

o  PROVIDE  INTERFACE  BETWEEN 
ATSC,  NTEC,  AND  CONTRACTOR 
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the  school's  point  of  contact  (POC)  for 
ail  problems  related  to  TEC.  At  various 
times  during  the  life  of  the  contract, 
you  will  be  communicating  directly  with 
the  Contracting  Officer's  Technical 
Respresentat ive  (COTR),  if  one  has  been 
assigned.  This  person  is  assjgned  by  the 
Government  (PM  TRADE  or  the  Naval 
Training  Equipment  Center  -  NTEC)  to 
supervise  the  contractor,  and  to  repre¬ 
sent  the  Government's  interests.  In 
addition,  you  may  have  occasion  to  com¬ 
municate  directly  with  the  contractor's 
on  site  representative,  if  one  has  been 
designated,  the  acquisitions  director 
(AD)  from  PM  TRADE,  and  the  NTEC  Project 
Engineer  (PE).  These  contacts  have 
been  established  as  part  of  the  standard 
operating  procedures  for  TEC  lesson 
development  and  reproduction.  But, 
anytime  there  is  a  problem,  or  you  have 
a  question  about  the  TEC  program,  you 
should  contact  your  ATSC/TPD  P0  first. 

It  is  ATSC/TPD's  responsibility  to 
provide  the  interface  between  the  schools 
and  PM  TRADE  or  NTEC. 

PA<  TRAPF.  The  Project  Manager  for 
Training  Devices  (PM  TRADE)  ass  gns  an 
acquisition  director  (AD)  to  a  given  TEC 
contract  who  directs  and  supervises  all 
contractual  actions,  development,  and 
reproduction  based  on  requirements  and 
priorities  established  and  directed  by 
ATSC/TPD.  The  AD  will  take  the  require¬ 
ments  presented  by  ATSC/TPD  and  incorporate: 
the  requirements  in  the  prescribed 
government  contracting  format.  Following 
this,  the  procurement  process  will  be 
accomplished.  After  the  contractor  has 
been  selected,  PM  TRADE  will,  in  selected 
cases,  assign  a  COTR  who  will  reside  at 
the  contractor's  place  of  work.  This 
COTR  will  monitor  and  facilitate  the 
orderly  progress  of  the  contract  during 
the  development  phase.  This  COTR  serves 
as  a  direct  point  of  contact  between 
the  school  and  the  contractor. 

The  overal t  management  and  super¬ 
vision  of  the  contractual  obligation  is 
the  responsibility  of  the  PM  TRADE  AD. 


'fw’SjfSTite-  ti 


■V. 


.  *.% 


.'ttifcj 


*yv>7 

-1 \  V  S. 


1 

4 


r 


« *1 


- '  ; 

V  • 


.VAvV-V.-'i i  I. 


This  AD  monitors  contract  performance, 
and  diverts  and  coordinates  the  develop¬ 
ment  and  implementation  of  remedial 
actions  when  contractual  problems  are 
identified.  Ordinarily,  this  person 
does  not  communicate  directly  with  the 
schools,  as  may  the  PM  TRADE  COTR,  but 
serves  as  the  interface  between  ATSC/TPD, 
PM  TRADE,  NTEC,  and  the  contractor. 


STTFC.  The  Naval  Training  Equipment 
Center  (NTEt)  provides  experts  to 
Pfl  TRADE  during  the  pre-award  phase  to 
evaluate  the  requirements  and  terms  of 
the  contract  with  respect  to  their 
feasibility  and  various  legal  issues. 

A  Project  Engineer  (PE)  is  assigned  to 
the  contract  to  provide  technical 
expertise  in  audiovisual  engineering 
and  to  assist  in  cost  and  schedule 
controls,  and  subsequent  validation  of 
contract  data  in  coordination  with 
Defense  Contract  Administrative  Services 
(DCAS) ,  In  addition,  a  COTR  is  placed  by 
NTEC  with  the  reproduction  contractor. 
Thjs  COJR  monitors  progress  during  the 
reproduction  phase,  checks  on  t he 
technical  quality  of  audio  and  visual 
materia),  and  serves  as  an  interface 
between  the  school  and  the  reproduction 
contractor. 


NTEC  RESPONSIBILITIES 

•  PROVIDE  AUDIOVISUAL 
EXPERTISE  TO  PM  TRADE  AND 
THE  SCHOOLS 

•  PROVIDE  REPRODUCTION  COTR 

•  JUDGE  TECHNICAL  QUALITY 
OF  LESSONS 


CotyVtacXo/i.  The  contractor  will 
analyze  the  GFM,  and  recommend,  subject 

to  approval  by  the  school,  the  media  _ _ _ 

to  be  used  for  a  given  lesson.  However, 

the  schooi  has  the  final  authority  CONTRACTOR  RESPONSIBILITIES 

on  media  selection.  The  contractor  will 

develop  the  required  lessons  in  •  ANALYSIS 

accordance  with  the  development  model 

approved  for  each  contract.  The  lessons  •  MEDIA  SELECTION 

v/ ill  be  submitted  to  the  school  for 

review  at  designated  junctures.  The  •  LESSON  DEVELOPMENT 

contractor  will  validate  the  lessons 

under  the  supervision  of  school  represent-  •  VALIDATION 
atives.  Following  validation,  the 

lessons  will  be  prepared  in  final  form  •  REPRODUCTION 

for  reproduction.  The  development  _  _______ 

contractor  normally  accomplishes 
reproduction  as  well  as  lesson  develop¬ 
ment.  Ip  some  cases,  however,  the 
lessons  are  sent  to  a  separate  reprod¬ 
uction  contractor. 
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1.3.2  Lines  of  Communicat ion 


PRE-AWARD  PHASE 
COMMUNICATIONS* 


(SCHOOL] 


ATSC/TPD  PO 


[PM  TRAb'E  ADI 


NTEC  PE  & 
CONTRACTING 


BIDDING  I 
CONTRACTORS 


DEVELOPMENT  PHASE 
COMMUNICATIONS* 

•I  SCHOOLS] 


CONTRACTOR'S 
ON  SITE  REP 


[PTl  TRADE  COTR 


[CONTRACTOR  | 


AT  SC 
PO 


PM  TRADE 
AD 


[NTEC  PE  | 


J~ ANSWER  PRINT  PREPARATION  ""| 
I  (NfEC~CQfRl - 1  1 


REPRODUCTION 

CONTRACTOR 


PAC-AtvaAcI  Phase..  While  the  contract 
is  being  written,  your  point  of  contact 
(POC)  for  all  TEC  related  matters  is 
your  PO  at  ATSC/TPD.  The  PO  will  coord¬ 
inate  requirements,  communicate  wi  th 
PM  TRADE,  and  participate  in  the  con¬ 
tractor  selection  process.  The  PM  TRADE 
representative  will  communicate  with 
NTEC,  and  manage  the  contract  preparation 
and  negotiation  phase. 


VcveJLopnenX.  Phase.  Your  primary  POC 
is  still  your  ATSC/TPD  PO.  This  PO  should 
be  contacted  in  the  event  of  questions 
or  problems  related  to  the  contract. 

Two  additional  POCs  you  may  encounter 
during  this  phase  are  the  contractor's 
on  site  representative  at  your  school,  and 
PM  TRADE'S  COTR  at  the  contractor's 
place  of  business.  Communications  con¬ 
cerning  the  routine  development  procedures 
should  be  directed  to  these  persons. 
However,  In  the  event  of  problems,  you 
should  first  contact  your  ATSC/TPD  PO. 

Th i s  PO  will  contact  the  PM  TRADE  AD  as 
necessary  to  follow-up  on  the  problem. 


■'■•These  diagrams  illustrate,  in  a  simplified  way ,  the  changes  in  lines  of 
communication  during  each  phase  of  the  contract.  They  do  not  illustrate  all 
possible  communications  that  might  occur  during  a  contract. 
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REPRODUCTION  PHASE 
COMMUNICATIONS* 


Rg>  toduc&ton  Pluue.  The  procedures 
here  are  essentially  the  same  as  during  the 
development  phase.  The  difference  is  that, 
in  some  cases,  you  will  now  be  in  communi¬ 
cation  with  an  NTEC  PE.  As  before,  the 
COTR  should  be  contacted  at  once  in  case 
of  problems. 


“Refer  to  previous  foot  note. 
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I.*  RESPONSIBILITIES  AND  TRAINING 
OPPORTUNITIES  FOR  TEC  DEVELOPMENT  MANAGERS 


There  is  no  simple  way  to  present 
a  list  of  responsibilities  and  guide¬ 
lines  for  a  TEC  Development  Manager. 

There  are  several  reasons  for  this: 

•  Differences  in  contractual 
requi remen ts 

•  Differences  in  working  conditions 

•  Differences  in  personal  style 

•  Differences  in  preparation  for 
project  management  responsibilities 

Despite  these  differences,  the  goal 
in  this  section  of  the  Guidebook  is  to 
provide  guidance,  especially  for  the 
newly  assigned  TEC  Development  Manager, 
with  respect  to  his  or  her  responsibi¬ 
lities.  This  section  will  also 
introduce  you  to  some  of  the  general 
characteristics  of  project  manage¬ 
ment,  and  suggest  methods  for  you  to 
obtain  additional  information  and 
training  relevant  to  your  responsibilities. 


VlvQA^iXij  o  &  Rc^poiU-tbilXttC-S.  The 
responsibilities  assigned  to  a  TEC  manager 
are  defined,  to  a  large  extent,  by  the 
contract.  But,  a  limitation  to  the 
contract  as  a  source  of  a  "job  description" 
is  that  it  describes  the  ends  but  not 
the  means.  It  tells  you  what  you 
must  accomplish,  but  not  always  how  to 
accomplish  it.  A  complete  job  descrip¬ 
tion,  or  management  guidebook,  should 
describe  how  to  accomplish  the  task. 

But,  in  the  case  of  the  TEC  manager, 
there  is  still  another  complication. 

There  is,  as  previously  indicated, 
great  diversity  among  the  schools  as  to 
the  ways  TEC  is  developed.  Some  schools 
work  entirely  on  contract,  others  do  some 
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in-house  development.  Because  of 
these,  and  other,  differences  in 
working  conditions,  it  is  important 
for  the  TEC  manager  to  become  competent 
in  the  general  skills  of  project  manage¬ 
ment,  and  to  discover  or  utilize  the 
most  appropriate  means  to  accomplish 
the  goals  In  a  given  school.  Thi s 
section  contains  an  overview  of  some  of 
the  responsibilities  related  to  contract 
management,  and  the  next  section  (l.1*. 2) 
describes  some  of  the  general  character¬ 
istics  of  project  management. 

:  i  ' 

GchcaoC  Cctta.(\oni(L&  oj  RciponAilytf.ifi<.e.4. 

One  category  of  responsibility  is 
derived  directly  from  the  contracting 
process.  Since  these  change  from  contract 
to  contract,  and  can  be  derived 
directly  from  the  contracts,  they  will 
not  be  presented  in  detail  here.  However, 
for  purposes  of  orientation,  we  will 
summarize  the  types  of  responsibilities 
associated  with  contract  obligations. 

They  fal|  roughly  into  three  categories: 
definition  of  requirements,  preparation 
of  government  furnished  material 
(GFM)  ,  and  supervision  of  contractor's 
work.  The  first  category  includes 
the  work  that  goes  into  preparing  the 
request  for  proposal  ( RFP )  which, 
eventually,  will  become  the  contract. 

Each  school  to  be  included  in  the 
contract  works  with  ATSC/TPp  to  define 
what  their  requirements  will  be  for  the 
contract.  Criteria  var i es 1 f rom  fiscal 
year  ( FY )  to  FY  for  selecting  subject 
material,  but  support  of  EPflS  can  be 
expected  to  always  be  a  major  consider¬ 
ation.  Once  subject  material  and  kits 
have  been  determined,  you  then  move 
into  the  second  category  of  responsi¬ 
bilities:  preparation  of  GFM.  As 
soon  as  the  contract  has  been  awarded,  and 
the  contractor  js  ready  to  begin 
work,  you  must  be  prepared  to  give  him 
al)  of  the  back-up  material  he  will  need 
in  order  to  be  able  to  do  his'job.  After 
turning  this  material  over  to  him,  you 
then  enter  your  third  phase  of  responsi¬ 
bilities:  supervision  of  contractor's 
work.  It  is  this  phase 


CONTRACT  RESPONSIBILITIES 


•  DEFINITION  OF  REQUIREMENTS 

•  PREPARATION  OF  GOVERNMENT 

FURNISHED  MATERIAL  (GFM) 

•  SUPERVISION  OF  CONTRACTOR'S 

WORK 
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of  your  responsibilities  that  is 
usually  spelled  out  in  detail  in  the 
contract.  Sonetimes  your  supervision  will 
be  indirect  in  that  you  will  be  critically 
evaluating  decisions  (e.g.,  media 
selection  recommendations)  and  products 
that  are  presented  to  you  by  the 
contractor.  At  other  times,  your 
supervision  will  be  direct  as  when  you 
oversee  the  contractor's  procedures 
while  he  conducts  validation  studies 
of  the  lessons.  But,  in  all  cases, 
it  is  important  for  you  to  remember  that 
in  conjunction  with  your  subject  matter 
experts  (SilE)  and  higher  level  staff, 
it  is  your  responsibility  to  make 
judgments  on  the  technical  and  doct¬ 
rinal  accuracy  of  the  contractor's 
product.  Assurance  that  the  kit 
meets  contractual  specifications  rests 
with  ATSC/TPD ,  PM  TRADE,  and  NTEC. 

R ate-Qft  PAcqAC-M  Rca >v!> IbiJUtA.. u . 

This  could  have  been  included  in  the 
general  categories  of  responsibilities, 
but  it  is  so  important  that  it  deserves 
special  attention.  The  TEC  program 
is  young,  it  has  grown  rapidly,  and 
it  has,  predictably,  encountered  some 
log  jams.  Both  the  contractors  and  the 
Army  have  had  to  slip  their  production 
and  review  schedules,  and  there  have 
been  delays  in  reproduction  and 
distribution.  But,  the  time  of 
tolerance  for  these  delays  is  past. 

These  log  jams  have  to  be  prevented, 
and  TEC  has  to  be  kept  on  schedule.  To 
emphasize  the  importance  of  keeping  TEC 
on  track,  TEC  is  a  major  area  of  interest 
in  the  commandant's  installation 
contract.  TEC  products  are  accounted  for 
and  reported  quarterly  to  the  commander 
of  TRADOC.  Unless  TEC  can  demonstrate 
both  that  its  products  arc  effective, 
and  that  its  products  are  beinq 
produced  and  fielded  in  an  acceptable 
length  of  time,  the  entire  program  will 
be  jeopardized.  Since  several  studies 
have  demonstrated  the  effectiveness  of 
TEC,  that  leaves  us  with  the  second 
problem  as  the  major  issue.  The  Army 
must  always  meet  its  schedule  of 
deliverables  and  reviews.  Only  in  this 
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via y  can  the  Army  then  take  a  firmer 
line,  if  necessary,  with  contractors  who 
persistently  have  trouble  meeting  dead¬ 
lines.  Needless  to  say,  the  primary 
responsibility  for  meeting  the  time  schedules 
falls  upon  you  since  there  are  many  school 
reviews  In  the  development  cycle.  Only 
with  your  effective  management  can  TEC 
stay  on  track! 

Sample  Job  VcACAiptiou.  The  following 
example,  which  is  a  composite  based  upon 
samples  received  fron  the  Transportation 
School  and  the  Quartermaster  School, 
describes  the  responsi b j i ities  of  a  TEC 
Development  Manager  (Branch  Chief),  TEC 
Project  Officer  gt  the  school,  educational 
specialist,  and  writer-editor  (not  to  be 
confused  with  SME's).  This  example 
illustrates  the  diversity  of  responsib¬ 
ilities  relevant  to  achieving  tfie  ob¬ 
jectives  of  TEC,  This  example  is  not 
suggested  as  a  model  for  all  schools. 

For  example,  it 

does  not  include  responsibilities  for 
in-housie  d°vel°PPient ,  which  would  be 
included  at  some  schools.  Furthermore, 
some  schools  do  not  have  staffs  which 
are  large  enough  to  allow  this  breakdown  of 
job  descriptions.  In  those  cases,  many 
of  these  tasks  would  be  the  sole 
responsibility  of  the  TEC  manager,  or 
distributed  in  a  different  manner  among 
two  or  three  people. 


MA.VA GER  RESPONSIBILITIES 


JOB  DESCRIPTIONS  -  EXAMPLES 
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Mager,  R.  F.  Preparing  i  rlstruct  iona  1  objectively.  Belmont,  California: 
Fearon  hub! i shers ,  1 962 .  (Contains  procedures  fur  developing 
objectives  for  instructional  material.) 

Mager,  R.  F.  Goal  analysis.  Belmont,  California:  Fearon  Publishers,  1972. 
(A  good  reference  for  the  development  of  instructional  objectives.) 

Mager,  R.  F.  6  Pipe,  P.  Criteri on -referenced  instruction.  Palo  Alto, 
California:  Mager  Associates,  Inc.,  1976.  (A  complete  set  of 
workbqoks  that  describe  the  design  arid  the  development  of  criterion- 
referenced  instruction.) 

TRADOC  PAMPHLET  350-30.  ISP-Executive  Summary.  Fort  Monroe,  Virginia: 

U.S.  Army  Training  and  Doctrine  Command,  August  1975-  (Provides 
overview  of  I SD  model.) 

TRADOC  PAMPHLET  3 50-30 .  I SD  Phase  I  I .  Fort  Monroe,  Virginia:  U.S.  Army 
Training  and  Doctrine  Command,  August  1975-  (Provides  information 
on  tfie  design  of  instructional  material.) 

TRADOC  PAMPHLET  350-30.  I SD  Phase  III.  Fort  Monroe,  Virginia:  U.S.  Army 
Training  and  Doctrine  Command,  August  1975.  (Provides  information 
on  the  development  of  instructional  material.) 


lJt.2  General  Project  Management  Cha  racter  i  s  t  i  cs 


Management  UcA&ui  Leadeulup. 

'.oo  often  jn  the  military,  industry,  and 
education,  it  is  assumed  that  bqcause  an 
individual  has  leadership  skills  and 
training,  he  or  she  is  prepared  to 
assume  the  responsibilities  of  project 
management.  Although  similarities  exist, 
there  are  many  aspects  of  project  manage¬ 
ment  that  require  more  than  leadership. 

Both  an  understanding  of  the  special 
nature  of  development  projects,  and  the 
appropriate  management  techniques  are 
required.  In  this  section  of  the  Guide¬ 
book  an  orientation  to  the  character¬ 
istics  and  problems  of  project  management 
are  provided.  For  the  newly  assigned  TEC 
manager  without  previous  project  manage¬ 
ment  experience,  this  orientation 
and  some  study  of  the  references  accompany¬ 
ing  this  section,  will  help  you  begin  to 
function  effectively.  You  should  also  feel 
free  to  call  upon  your  ATSC/TPD  P0,  and 
experienced  colleagues  at  other  TEC 
schools.  They  will  be  more  than  happy  to 


•  A  MANAGER  HAS  TO  BE  A 
GOOD  LEADER 

e  A  GOOD  LEADER  IS  MOT 
ALWAYS  A  GOOD  MANAGER 
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PROJECT  MANAGERS  SHOULD  HAVE 

•  INTERPERSONAL  SKILL 

•  ORGANIZATIONAL  SKILL 

•  ANALYTICAL  SKILL 

•  TECHNICAL  SKILL 


share  the  i  r  experience  v/i  th  you.  As 
you  work  in  this  assignment,  you  will 
descover  that  TEC  development  managers  are 
enthusiastic  and  willing  to  do  what 
they  can  to  help  a  colleague  as  a  means 
of  helping  obtain  the  highest 
quality  program  possible. 

I'Jhat  PAujo_CJt  Management?  Almost 
all  definitions  of  project  management 
inculde  or  imply  the  following  elements: 

The  project  manager,  by  working 
with  people  and  other  resources, 
must  produce  the  product,  or 
other  outcomes  defined  by  the 
objectives  of  the  project,  on 
tine,  according  to  standards, 
and  within  the  al located  budget. 

This  definition  implies  certain  skills 
that  are  important  for  a  project  manager 
to  possess: 

•  Interpersonal  Skill:  To  an 
increasing  degree  almost  every 
expert  in  management  emphasizes 
the  importance  of  interpersonal 
skills  in  project  management. 

Even  in-a  hierarchical  organization 
such  qs  the  Army,  a  successful 
project  is  the  result  of  the 
coordinated  efforts  of  many  people. 

It  will  always  be  the  case  that 
some  of  these  people  ore  not  in 
the  hierarchy  under  the  personal 
control  of  the  TEC  manager.  The 
successful  TEC  manager  is  able  to 
enlist  the  assistance  of  people 
whose  expertise  or  resources  are 
needed,  even  when  there  is  no 
immediate  obvious  payoff  for  those 
people.  Even  when  key  people  are 
in  the  command  of  the  TEC  manager, 
projects  will  not  make  satisfactory 
progress  unless  these  people  are 
motivated  and  productive. 

•  Organizational  Skill:  The  successful 
TEC  manager  is  able  to  maintain  a 
vision  that  is  larger  than  his 
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immediate  area  of  responsibility. 

F9  The  best  project  managers,  in 

industry  and  education  as  well  as 
the  millatary,  are  able  to  concep- 
tqalize  the  "big  picture,"  and  have 
their  work  fit  into  it.  Having  this 
perspective  helps  the  project 
manager  make  decisions  that  are  in 
the  best  interest  of  the  project 
and  the  larger  organization. 

•  Analytical  Skill:  Just  as  the  whole 
picture  is  important,  so  are  the 
details.  The  effective  project 
manager  is  able  to  break  the  whole 
down  into  pieces,  and  to  have  an  eye 
for  the  detail  that  comprises  each 
of  the  pieces.  A  concern  for  detail 
wi|l  not,  by  itself,  automatical ly 
result  in  excellence,  but  there  will 
be  no  excellence  without  a  concern 
for  detail,  ,his  does  not  mean  that 
the  TEC  manager  has  to  keep  personally 
In  touch  wjth  every  detaij  of  every 
lesson  that  is  being  developed,  but 

it  does  mean  that  he  can  perceive 
the  detail  when  heed  be.  And  it 
means  that  he  Instills  this  concern 
in  his  personnel . 

•  Technical  Skill:  Knowledge  of  the 
product  or  its  contents,  and 
experience  wi*h  project  management 
are  both  helpful.  The  TEC  manager 
should  know  at  least  enough  about 
the  content  areas  so  that  he  can 
judge  the  work  of  the  subject  matter 
experts  (SMEs)  who  may  be  working  on 
a  project.  If  he  does  not  have  that 
Knowledge,  he  should  make  an  effort 
to  acqujre  it.  Similarly,  experience 
in  project  management  is  valuable 

for  the  simple  reason  that  many 
unprogranimabl e  decisions  have  to  be 
made.  The  experienced  manager  will 
be  far  better  equipped  to  handle  many 
of  the  uncertainties  associated  with 
project  management.  This,  of  course, 
leaves  us  with  the  obvious  dilemma 
of  what  does  the  inexperienced  project 
manager  do?  The  main  thing  is  to 
undprstand  that  it  is  normal  to  have 
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PROJECT  MANAGEMENT  IS 

•  OBJECTIVES  ORIENTED 

•  NON-REPETITIVE 

•  TIME-BOUND 

•  INTER-ORGANIZATIONAL 


to  make  decisions  in  the  face  of 
uncertainty,  and  to  learn  as  much 
as  possible  from  experienced 
col  leagues. 

ClicviacjQA4Atie.!>  oh  Psioject  Managa- 
mut  VeAAiu  dthcA  LmcfeAAlup  " 
A464.gnme.nt4.  Generally  speaking,  as 
a  TEC  manager,  you  have,  or  might, 
encounter  the  following  types  of  leadersh 
assignments:  commander,  administrator,  or 
project  manager.  The  requirements  of 
each  differ  in  important  ways.  For 
example,  command  responsibility  requires 
that  you  establish  policy  within  your 
sphere  of  decision  making,  and  that  you 
be  primarily  concerned  with  commanding 
people  rather  than  supervising  processes. 
The  other  two  types  of  leadership 
responsibility  both  require  the  supervis¬ 
ion  of  processes,  but  they,  too,  differ 
significantly.  Managers  have  to  set 
policies,  determine  standards,  make 
unprogrammed  decisions,  and  cope  v/ith 
a  high  degree  of  uncertainty  due  to 
the  degree  of  non-repetitiveness  in 
projects.  Administrators,  on  the  other 
hand,  are  concerned  with  implementing 
policy,  and  they  tend  to  deal  mostly  with 
structured,  predictable,  and  relatively 
unambiguous  situations.  As  you  can  see, 
project  management  requires  the  very  type 
of  personal  initiative  and  decision 
making  that  is  discouraged  in  more 
structured,  administrative  assignments. 

Development  projects  have  several 
character i st i ces  that  distinguish  then 
from  most  other  organizational  units. 

In  general  projects  are: 

•  Objectives  oriented:  A  project 
exists  for  the  sake  of  producing  a 
product,  or  other  tangible  outcome. 
Only  those  tasks  are  assumed  by  a 
project  that  lead  to  the  accomplish¬ 
ment  of  the  objectives. 

•  Non-repet i t ive  in  whole  or  part: 

Once  the  objectives  have  been 
achieved,  the  project  is  finished. 
There  may  be  overlapping  or  sequent¬ 
ial  projects  which  are  the  responsi¬ 
bility  of  the  same  personnel,  but 
each  project  has  a  definite  goal  and 
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time-line.  Even  though  the  other 
projects  may  be  similar,  and  exper¬ 
ience  with  one  will  transfer  to 
the  next,  there  will  still  be 
unique,  non-programmable  problems 
and  decisions  to  be  made.  This 
results,  in  part,  from  changes 
in  specifications,  personnel,  and 
other  resources. 


•  Time-bound:  A  project  carries  due 
dates.  Often  the  products  from  one 
project  have  10  interface  with 
another  project.  Frequently,  there 
are  serious,  negative  consequences 
if  a  manager  cannot  meet  deadlines. 


•  Inter-organizational:  Projects  have 
a  tendency  to  cut  across  established 
organizational  boundaries.  This 
happens  because  a  project  will 
often  require  experts  and  resources 
that  are  not  available  In  the 
parent  organization.  Since 
projects  are  often  one-shot 
endeavors,  it  could  be  inefficient 
to  incorporate  all  of  the  required 
resources  into  the  parent  organiz¬ 
ation.  Therefore,  the  project 
mapager  often  has  to  be  skilled 

at  locating  and  utilizing  resources 
from  diverse  sources. 

The  Function  otf  a  Manager.  Classically, 
the  functions  of  a  manager  are  defined 
as  planning,  organizing,  directing  (or 
motivating),  arid  controlling. 

•  Planning:  Planning  is  future 
oriented.  The  manager  must  identify 
objectives,  and  prepare  time-lines, 
budgets,  policies,  and  staffing 
requirements  that  will  facilitate 
their  accomplishments. 


•  Organizing:  The  manager  must  identify 
resources,  prepare  job  descriptions, 
delegate  tasks,  establish  patterns  of 
communications,  and  integrate  all 
project  activities  toward  the  goal  of 
accomplishing  the  project  objectivies. 


MANAGERIAL  FUNCTIONS 

•  PLANNING 

•  ORGANIZING 

•  DIRECTING 

•  CONTROLLING 
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•  Directing  (motivating):  The 
manager  must  exert  leadership, 
and  other  types  of  influence, 
so  that  subordinates  will 
accomplish  their  tasks.  The 
manager  must  be  able  to 
delegate  authority,  and  to 
secure  cooperative  working 
relationships  with  other  units. 

•  Controlling:  The  manager  must 
exercise  quality  control  by 
comparing  performance  to 
standards  and  correcting  discre¬ 
pancies.  This  applies  to 
process  events,  such  as 
personnel  performance,  and  to 
product  characteristics. 

The  TEC  manager's  responsibil¬ 
ities  that  were  described  in  the  last 
section  (1.4.1)  fit  conveniently  into 
these  four  functions,  but  these  funct¬ 
ions  are  broader  than  the  earlier  list. 
The  earlier  list  describes  your 
"ends-or iented"  responsibi 1 i ties. 

They  were  the  tasks  that  are  directly 
related  to  the  development  and 
completion  of  a  TEC  contract. 

The  four  functions  presented  in  this 
section  also  include  "means-oriented" 
responsibilities.  For  example,  under 
planning,  you  must  do  more  than  plan 
the  requirements  of  the  contract. 

You  must  also  plan  your  internal 
organization  and  time  lines.  Then, 
yoq  will  need  to  implement  the 
organizational  plan,  supervise  the 
personnel,  and  maintain  quality 
control.  Some  of  these  broader,  means- 
oriented,  responsibilities  are  embedded 
in  the  example  presented  in  the 
previous  section  (See  Sample  Job 
Description  in  Section  1.4.1). 


Common  PAoblmi  in  Pn.ajc.ct  Management. 
There  are  certain  problems  that  occur 
so  often  in  project  management,  that  they 
do  not  fit  into  our  normal  definition 


of  a  problem.  Usually,  we  think  of  a 


problem  as  an  out-of-the-ordinary 


impediment  to  progress.  Once  we  solve 
the  problem,  we  either  do  not  expect 
it  to  ocxur  again,  or  we  have  a  solution 
ready  for  it.  Such  is  not  the  case  in 
project  management.  There  are  several 
categories  of  problems  that  are  recurrent, 
but  the  solutions  tend  to  differ  each  time 
because  of  the  nature  of  projects. 
Therefore,  we  will  describe  some  of 
these  problems  so  you  will  be  aware  of 
them,  but  we  cannot  present  simple 
solutions.  The  solutions  will  result 
from  your  overall  knowledge  of  your 
project  and  its  objectives,  your  gen¬ 
eral  problem  solving  ability,  your  ex¬ 
perience,  and  your  ability  to  draw  on 
the  experience  of  others. 

•  Hierarchical  versus  horizontal 
relationships:  Often  you  will 
need  personnel,  such  as  subject 
matter  experts,  and  services  from 
units  over  which  you  have  no  direct 
authority.  Securing  this  cooperation 
in  timely  manner  often  poses  a  real 
challenge  to  achieving  your  mile¬ 
stones  on  schedule. 

i 

•  Deadlines  versus  quality:  No 
project  manager  wants  to  turn  out 
products  which  are  not  high  quality, 
ancj  it  is  Imperative  that  the  Army 
have  high  quality  training  materials. 
However,  some  project  managers 

can  get  into  trouble  by  striving 
for  an  excessive  degree  of  per¬ 
fection  that  interferes  with  getting 
the  products  out  on  time.  |t 
js  always  possible  to  identify 
onp  more  revision  that  can  be  made 
on  a  product;  it  can  be  a  never 
ending  cycle.  Achieving  top  quality 
products,  and  getting  them  out  on 
time  is  a  real  challenge  to  any 
project  manager. 

•  Responsibility  versus  authority: 

Even  though  t he  project  manager  has 
the  responsibility  for  achieving 
the  project's  object ivjes,  he  does 
not  always  have  complete  authority 
over  personnel,  schedules,  budget,  or 


MANAGERIAL  PROBLEMS 

•  HIERARCHICAL  VS  HORIZONTAL 
RELATIONSHIPS 

•  DEADLINES  VS  QUALITY 

e  RESPONSIBILITY  VS  AUTHOR¬ 
ITY 

•  DETAILED  SUPERVISION  VS 
MANAGEMENT  BY  EXCEPT IOfl 

•  PROJECT  PRIORITIES  VS 
ORGANIZATIONAL  PRIORITIES 
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performance  specification.  This  can 
be  particularly  vexing  to  the  project 
manager  since  it  curbs  his  sphere  of 
decision  making. 

•  Detailed  supervision  versus  management 
by  exception:  The  project  manager  is 
accountable  for  the  outcomes  of  the 
project,  but  in  a  complex  project,  it  is 
impossible  to  supervise  every  detail  of 
every  event.  The  manager  has  to  manage 
by  exception  to  some  degree;  that  is,  he 
has  to  identify  sensitive  or  critical 
events  and  observe  only  those.  He  moves 
into  the  role  of  detailed  supervision  only 
when  there  is  a  problem.  Being  able 

to  identify  the  critical  points  and 
achieve  the  right  balance  of  supervision 
is  a  real  source  of  problems. 

•  Project  priorities  versus  organizational 

priorities:  Projects,  by  their  very 

nature,  tend  to  become  ends- i n-them- 
selves.  The  TEC  manager  may  begin  to  see 
TEC  as  the  panacea  for  all  training  problems 
The  commander  of  a  field  unit,  who 

has  no  vested  interest  in  TEC,  may 
see  it  as  only  one  of  several  resources 
as  he  attempts  to  build  a  well  trained 
ugit.  Farlureto  obtain  a  larger 
perspective  than  one's  immediate 
responsibility  can  create  many  problems 
for  a  project  manager. 
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1  M  .  3  Dealing  w_ith  Contractors 

General  Bac.kgn.ound.  A  considerable 
amount -of  your  time  will  be  spent  in 
interactions  with  your  contractor. 

And,  to  a  great  extent,  the  success 
of  your  project  wi | 1  depend  upon 
your  ability  to  develop  a  productive 
working  relationship  with  your 
contractor.  Therefore,  it  is  important 
for  you  to  know  how  to  deal  wi th 
contractors  in  terns  of  techniques, 
responsibilities,  authority,  and 
logal  boundaries.  With  respect  to 
techniques,  it  is  impossible  to  present 
a  list  of  clear~cut  procedures. 

Most  individuals  will,  with  expereince, 
work  out  their  own  best  methods  of 
managing  contracts.  However,  this 
prqblem  has  been  researched  by 
scientists,  especially  Industrial 
psychologists,  and  there  is  a 
growing  literature  on  the  subject 
of  contractual  relationships.  The 
one  ideq  that  we  would  like  to  bring 
to  your  attention  from  this  literature, 
is  the  concept  of  formal  versus 
informal  contracts.  This  concept  has 
proven  useful  to  managers  who  have  to 
supervise  contracts  in  the  process 
of  fulfilling  their  project  objectives. 


TO  DEAL  EFFECTIVELY  UITH 
CONTRACTORS 

•  WORK  WITH lil  BOTH  FORMAL 
AND  INFORMAL  CONTRACTS 

•  RECOGNIZE  THE  ASPECTS  OF 
DEVELOPMENT  WHERE  EXPECT¬ 
ATIONS  (BOTH  SCHOOL  AMD 
CONTRACTOR)  MIGHT  DIFFER 


The  formal  contract  is  the  legal 
contract.  It  consists  of  the  stated 
agreements  In  the  signed  contract. 

The  informal  contract  refers  to  the 
psychological  aspects  of  thelrelation- 
ship.  |t  consists  of  all  the  unstated, 
or  difficult  to  state,  expectations 
of  the  two  parties  to  the  contract. 

It  is  very  important  to  consider  both 
of  these  aspects  in  relation  to  your 
TEC  contract,  or  any  local  contracts 
you  might  write  in  support  of  in- 
house  development.  Your  responsibility 
and  authority  in  relation  to  the 
formal  contract  are  discussed  later  in 
this  section. 

Expectations  can  differ  in  many 
ways  when  contracting  the  software. 


* _ _ _  _ 


It  is,  on  the  one  hand,  fairly 
easy  to  define  a  time-line  for 
deliverables  and  reviews,  and  to 
define  the  deliverables  in  general, 
descriptive  terms  such  as  kits,  lessons, 
final  art,  etc.  On  the  other  hand, 
it  is  extremely  difficult  to  work 
out  the  detailed  specifications. 

When  you  contract  for  a  generator, 
it  is  relatively  easy  to  specify 
many  characteristics  of  the  final 
product  in  terms  of  its  composition, 
output,  and  durability.  But,  with 
educational  software,  the  problems 
are  far  more  complex.  The  complexity 
results  from  the  lack  of  a  technology 
which  allows  us  to  specify  every 
important  learning  and  motivational 
characteristic  of  a  lesson  in  terms 
of  a  particular  arrangement  of  words 
and  pictures.  It  also  results 
from  the  degree  of  human  interaction 
that  occurs  during  the  development  ' 
process.  This  offers  many  opportunities 
for  the  TEC  manager  and  the  contractor 
to  have  very  different  expectations 
about  the  desires  and  obligations  of 
each  other. 

An  example  might  help.  Every 
TEC  contract  require.s  the  TEC  managers 
to  provide  GFM  for  the  contractor, 
apd  some  guidelines  are  provided. 

But  there  is  still  an  unanswered 
question  as  to  how  detailed  the  GFM 
should  be.  Some  schools  provide 
coordination  and  contract  summary 
sheets  that  are  almost  detailed 
enough  to  be  used  as  draft  scripts. 

Other  schools  provide  an  outline  with 
technical  back-up  information  and 
expect  the  contractor  to  write 
scripts.  The  expectations  of  the 
schools  differ  greatly  with  respect 
to  the  amount  of  detail  in  art.  This 
can  be  a  substantial  problem  for  a 
contractor  who  deals  with  several 
schools  and  the  expectations  of 
each  school  are  different.  Therefore, 
it  is  important  for  the  TEC  manager  to 
learn  to  recognize  the  many  aspects 
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VEAU-JG  WITH  CONTRACTORS 


of  development  where  expectations 
might  differ,  and  to  discuss  these 
with  the  contractor.  Many  hours, 
and  days,  of  development  time  can 
be  saved  by  establishing  an  effective 
working  relationship. 

R ctponbibilitic*  and  Aathofuiij. 

The  responsibilities  of  the  TEC  manager 
are  included  jn  each  TEC  contract.  Since 
they  are  not  exactly  the  same  in  each 
contract,  you  Should  study  each  contract 
and  develop  some  type  of  checklist  for 
reference  and  guidance.  With  respect 
to  authprity,  you  are  not  authorized  to 
deal  djrectly  with  a  contractor  or  make 
agreements  which  obligate  the  govern¬ 
ment  or  effect  changes  in  the  contract. 

If  any  problems  occur  relative  to  the 
terms  of  the  contract,  you  should  contact 
your  ATSC/TPD  PO  who  wi 1 1  assist  you 
in  following  it  through  to  the  contract¬ 
ing  officer.  You  are  required  by  the 
contract  to  make  important  judgments  about 
the  contractor's  work.  These  include 
media  selections,  technical  accuracy, 
quality  of  art,  and  overall  quality  of 
the  lesson  as  specified  by  the  contract. 

It  is  important  for  you  to  exercise  this 
authority  and  not  rely  on  the  contractor's 
judgment . 

The  contractor  is  an  expert  in  his 
field,  but  you  represent  the  target 
population.  It  is  up  to  you  to  be 
concerned  with  the  most  cost  effective 
methods  of  development,  and  the  accept¬ 
ability  of  the  products  to  the  users. 


•  KriOW  THE  CONTRACT 

•  DEVELOP  REFERENCE  AMD 
GUIDANCE  CHECKLISTS 


DETERMINE 

•  THE  MOST  COST  EFFECTIVE 
METHODS  OF  DEVELOPMENT 

•  THE  ACCEPTABILITY  OF  THE 
PRODUCTS  TO  THE  USERS 


Local  CanjACLC ting .  Contracting  locally 
for  services  to  assist  with  in-house 
development  presents  many  special 
problems.  In  order  to  do  so,  you  should 
have  considerable  experience  with 
whatever  you  are  contracting  for,  and 
with  thp  regulations  concerning  procurement. 
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LOCAL  CONTRACTING  PROBLEMS 

•  JUDGING  PROPOSALS 

•  KNOWING  GOVERNING 

REGULATIONS 


First,  unless  you  have  experience 
with  the  services  you  are  buyinq, 
it  will  be  difficult  for  you  to 
judge  proposals  with  respect  to 
time,  costs  and  quality.  Second, 
you  may  encounter  many  difficulties 
unless  you  learn  the  regulations 
governing  this  type  of  procurement. 
Your  local  procurement  office  can 
work  with  you  on  such  a  contract. 
Before  beginning  this  type  of  con¬ 
tractual  activity,  however,  you 
should  talk  with  some  experienced 
TEC  managers.  Your  ATSC/TPD  PO  will 
be  able  to  recommend  some  names  to 
you. 


I.1*.1*  Training  Opportunities 
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l'JoA.fi6hop6 .  At  present,  there 
is  one  workshop  that  is  available 
to  TEC  personnel.  This  workshop, 
Criterion  Referenced  Instruction 
(CRl),  is  offered  by  Training  De¬ 
velopments  Institute  (TDl),  TRADOC, 
It  is  currently  being  offered  at 
regular  intervals  at  a  variety  of 
locations,  and  a  large  number  of 
TEC  personnel  have  participated. 

You  should  contact  your  ATSC/TPD  PO 
for  more  information  about  this 
workshop . 

RefieAe.nce.& .  Much  of  your 
training  will  have  to  result  from 
your  personal  reading  and  on-the- 
job  experience.  There  are  many 
publications,  both  military  and 
civilian,  on  the  topic  of  train¬ 
ing,  and  the  preparation  of  train¬ 
ing  programs  and  materials.  In 
this  chapter,  we  have  included  a 
few  of  the  most  salient  in  con¬ 
sideration  of  the  responsibilities 
of  TEC  manager.  If  your  interests 
go  beyond  these,  the  bibliographies 
in  these  publications  will  guide 
you  to  the  larger  area  of  literature 
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2.0  PLANMIMG  AND  ADMINIS¬ 
TRATION  Of-'  A  TEC  UNIT 


puring  the  last  decade,  a 
significant  advance  v/as  made  in 
the  f|eld  of  training  develop¬ 
ment.  It  resulted  from  applying 
general  systems  theory  to  the 
process  of  training  and  educa¬ 
tional  development.  The  impact 
of  this  planning  technique  was 
so  dramatic  that  it  contributed 
to  the  development  of  a  new 
field  of  specialization  known 
as  edgcatlonal  ,  or  instruc¬ 
tional  technology.  Initially, 
this  technology  was  developed 
in  colleges  apd  universities, 

3nd  In  industry,  but  it  has  qow 
been  adopted  by  the  Army  and 
other  branches  of  the  service. 

As  a  member  of  the  TfC  program, 
you  wj 1 1  see  this  technology 
being  applied  on  a  broader 
scale  than  ever  before.  It  is 
a  large  project  that  involves 
virtually  every  school  and 
unit  In  the  Army. 

The  purpose  of  this  chapter 
is  to  present  a  systematic  ap¬ 
proach  to  course  development. 
This  is  accomplished  by: 

•  Describing  the  relation¬ 
ships  between  TEC,  the 
Instructional  Systems  De¬ 
velopment  (ISD)  model,  and 
Directorates  of  Training 
Development . 

•  Explaining  how  Subject 
Matter  Experts  (SliEs) 
a. e  used. 

•  Reviewing  recurring 
report  requirements. 


PLANNING  AND  ADMINISTRATION 


PLANNING  AND  ADMINISTRATION  OF 
A  TEC  UNIT 

f  SYSTEMATIC  COURSE  DEVELOPMENT 

•  TEC  AND  ISD 

f  PLANNING  REQUIREMENTS 

•  SUBJECT  MATTER  EXPERTS 

•  RECURRING  REPORTS 
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2.1  SYSTEMATIC  APPROACHES  TO 
COURSE  DEVELOPMENT 


!n  its  broadest  scope,  the 
systems  approach  has  moved  beyond 
TEC;  it  has  been  adopted  by  the 
U.S.  Army  Training  and  Doctrine 
Command  (TRADOC )  as  a  means  of 
planning  and  implementing  a 
total  training  concept.  This 
concept  (see  Section  1.1.6)  will 
result  in  a  totally  integrated 
and  validated  performance- 
oriented  training  program  for 
the  Army. 

In  this  section  of  the 
Guidebook,  we  will  introduce  you 
to  the  systems  approach,  partic¬ 
ularly  as  it  is  represented  in 
two  documents  that  are  widely 
distributed  among  Army  train¬ 
ing  development  personnel.  The 
first  of  these  is  TRADOC  Pamphlet 
350-30,  Interservice  Procedures 
for  Instructional  Systems  Devel¬ 
opment.  The  second ,  Cr i terion- 
Referenced  Instruction  by  R.  F.  Hager 
and  P.  Pipe,  is  available  through 
a  workshop  conducted  by  TDI , 

TRADOC  which  is  frequently 
attended  by  school  training 
personnel  . 


2.1,1  Systematic  Course 
Development 


Cau-tioncvui  Note..  V/e  have  to 
open  this  section  wi lh  a  caution: 
there  are  many  ways  of  portray¬ 
ing  the  systems  approach  to 
instructional  development.  A 


recent  graduate  student 
^  of  Instructional  technol¬ 

ogy  identified  over  AO  dif¬ 
ferent  models  that  have 
been  published  in  the  lit¬ 
erature  of  the  field. 
Therefore,  we  cannot  say 
that  there  ;s  one  best 
model  for  development. 
Models  vary  depending  upon 
the  circumstances  in  which 
a  given  project  takes  place. 


OveAv^eio.  Despite  this 
diversity,  there  are,  at  an 
abstract  level,  some  featgres 
that  are  common  to  most  of 
the  models.  Most  of  them 
begin  by  doing  a  needs  anal¬ 
ysis  or  a  problem  analysis, 
and  $  task  analysis  in  order 
to  determine  what  tasks  are 
to  be  included  in  t he  train¬ 
ing  program.  The  second 
major  group  of  steps  in¬ 
volves  the  specification 
of  objectives  and  tests; 
that  is,  the  observable 
outcomes  of  the  program  are 
described,  qnd  methods  to 
measgre  them  are  developed. 

The  third  major  group  of 
steps  includes  the  design 
of  ap  appropriate  sequence 
of  iqstrgctlon,  and  the 
selection  of  an  appropriate 
strategy  for  instruction. 

Th | s  would  include  media 
selection.  The  fourth 
group  of  steps,  often 
called  development,  includes 
the  preparation  of  an  initial 
version,  a  try-out,  revision, 
and  validation  in  order  to 
see  whether  fhe  training 
laterial  meets  the  objectives. 


SYSTEMATIC  COURSE  DEVELOPMENT 

t  NEEDS  ANALYSIS  AND  TASK 
ANALYSIS 

•  SPECIFICATION  OF  OBJECTIVES 

AND  TESTS 

•  DESIGN  OF  INSTRUCTION 

•  DEVELOPMENT  OF  INSTRUCTION 

•  IMPLEMENTATION  OF  INSTRUCTION 
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After  the  validation  is  finished, 
the  last  phase  begins.  This 
fifth  phase,  or  implementation, 
includes  the  process  of  putting 
the  materials  into  the  training 
system,  management  of  their  use, 
and  continuous  monitoring  of 
their  ef f rxt i veness . 


INSTRUCTIONAL  TECHNOLOGY 
SYSTEMS  APPROACH 

•  SYSTEMATIC  ANALYSIS 

•  PREPARATION  OF  INSTRUCTION 

•  VAU I NATION 


VJA.tinguAAlung  TtucUuAU  o & 
the  Si/4t<?jns  App^oacIT.  In  these 
few  words,  we  have  attempted  to 
gjve  you  an  overview  of  the  pro¬ 
cess.  Its  distinguishing  fea¬ 
tures  are  that  a  systematic 
analysis  is  performed  in  order 
to  determine  what  should  be 
taught,  as  opposed  to  relying 
on  tradition  or  one  person's 
judgment.  After  that  determi¬ 
nation  has  been  made,  the 
Instructional  technologist  pre¬ 
pares  a  teaching  sequence  and 
strategy  based  on  the  latest 
research  in  the  areas  of  com¬ 
munication  and  psychology. 

Then,  after  designing  and  de¬ 
veloping  the  training  materials, 
the  instructional  technologist 
mlist  literally  "put  his  money 
where  his  mouth  is."  If  the 
materials  do  not  validate, 
then  they  must  be  revised  until 
they  do;  this  is  one  of  the 
most  rigorous  features  of  the 
systems  approach,  viz. ,  per¬ 
formance-oriented  instruction. 
The  materials  have  to  be  proven 
to  be  effective  before  they 
can  be  put  into  the  field. 


IntdAicAv-lcQ.  Pstoccdusiei 
I $04  InAtMiztioncii  Sij^tcjmTVz- 
velopiv&Tt.  As  a  TEC  Manager 
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you  will  frequently  encounter 
the  term  "|SD."  This  refers 
to  TRADOC  Pamphlet  350-30, 
interservice  Procedures  for 
Instructional  Systems  Devel¬ 
opment  ,  more  commonly  known 
as  the  ISO.  The  five  volumes 
of  this  pamphlet  constitute 
one  of  the  most  complete 
textbooks  avni lable  either 
from  the  Government  or 
commercially,  on  the  sys¬ 
tematic  approach  to  instruc¬ 
tional  development,  If  it 
fias  any  majpr  fault,  from 
the  point  of  view  of  the 
TEC  Manager,  it  is  that  it 
is  too  complete,  it  con¬ 
tains  far  more  detail  than 
you  need  to  know  as  a  TEC 
Manager.  You  will  work 
closely  with  the  outputs 
of  certain  phases  of  ISO, 
and  will  follow  some  of 
the  procedures  in  the  de¬ 
sign  and  development  of 
TEC  lessons.  You  will  not, 
however,  be  involved  with 
many  of  the  procedures 
outlined  there.  Ip  order 
tor  you  to  fie  able  to  ap¬ 
preciate  the  completeness 
of  fhis  model,  and  to  have 
a  reference  to  the  set  of 
manuals,  we  have  •'epro- 
duced  the  overview  of  the 
Five  Phases,  the  Blocks 
in  each  Phase,  and  the 
Outputs  of  each  Phase. 
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THE  OUTCOMES  OF  THE  BLOCKS  A  HE 


.  *  l'»  of  laJki  perform*)  in  •  p*t*ul*  job. 

•  lilt  of  talks  for  naming. 

«  |9b  performance  maaujrt  for  i*ch  tatk  wlecratJ  for  ini'.ruCt’O.r 
,  an  analyse  of  tha  jub  analyst.  tttk  traction,  am)  parformarva 
construction  for  any  asking  rmuwction  to  datarm-na  tf  th#ta  eou*w»  a>* 
uubta  ift  *ho>a  or  in  port. 

uUct-on  of  tha  miwgctiOn al  satl'og  for  tuk  sa'actfd  for  id  n 


a  Earning  objact  vt  for  ami  a  Uiming  a/ufyw  ul  a#:h  talk  i-iKir  f  for 
instruction. 


tail  •tfi’Pt  to  maisuia  aach  laarmng  otx.rctma 

a  last  of  antry  bfhav-ort  to  ua  if  tha  original  ttwmptio  \  *****  cur'cci 
,  th#  wq^ancin)  of  atl  rtrpaManf  tavk a 


tha  dauificatKM  of  Warning  objectives  by  training  category  and  tha 
idantificatlon  of  ippropriaia  laarning  guidalinat 

|ha  rrad’l  M'rationi  for  instructional  da  valebant  and  tha  mm  tout 
manigamant  plait  lor  conducting  tha  intrusion 

tha  anafy^it  of  packatai  of  any  fritting  instruction  that  maeit  tha  gi»«n 
laarnmg  obfrctivav 

tha  davaloprnant  of  intauction  for  all  laarning  objKii*r»  u.s«ia  r*.ttir.g 

malarial*  i»t  not  ivi-Ubk. 

f-aid  tartad  and  tavitad  initructional  malarial!. 


.  doauntnti  containing  information  on  t»ma.  tpacr.  Hudant  and  instructional 
i 'sour?  n,  and  ttaff  I  a.n#d  to  conduct  tha  induction. 

,  a  co^pidtad  cycta  of  instruction  with  information  rvadKl  to  improva  it  for 
tha  tueratdmgcygla. 


.1 .  .  .  data  on  inttructionalaffarlirfratt. 

.2  data  on  job  perform***  In  tha  fitkl, 

.3.  .  irstruct-onal  tytiam  rr«i»*d  on  basis  of  tmpif  icai  data 


Our  recommendation  is 
that  you  read  the  first  vol¬ 
ume,  Executive  Summary  and 
Mode] ,  and  the  third  volume, 
Phase  II:  Design,  in  thejr 
entirety,  the  first  v/i  1 1  give 
you  an  overview  pf  the  system, 
and  the  third  volume  covers 
many  of  the  tasks  for  which  you 
are  responsible.  You  are  also 
responsible  for  supervising  the 
development  process,  but  we  do 
not  see  it  as  essential  for 
you  to  read  all  of  the  fourth 
volume,  Phase  III:  Develop. 
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Blocks  111.2,  I  I  I  .1* ,  and  I  II  .5 

are  more  applicable  to  TEC  than 
the  other  two.  This  volume 
is  very  large  and  contains  much 
information  that  is  not  relevant 
to  the  TEC  development  process. 
It  would  be  more  valuable  for 
you  to  study  the  development 
model  that  is  included  in  any 
contracts  you  are  working  under 
and  to  browse  throuqh  the  .SD 
development  phase. 


CnAX&Uon-Re.6oAc.nc.c.d  Jm- 
tULCJtTon  and  tho~  1SV.  The  ex¬ 
pression  "cr  i  ter  ion- referenced 
instruction"  is  commonly  used 
to  describe  instruction  that 
has  competency  rather  than  com¬ 
petitiveness  as  its  goal.  In 
competitive,  or  norm-referenced, 
instruction  and  testing,  the 
goal  is  to  select  a  given  per¬ 
centage  of  trainees  who  come 
out  at  the  top.  A  norm-refer¬ 
enced  test  is  designed  to  rank 
order  people  from  best  to  v/orst. 
The  scores  are  based  on  the 
avepage  score  of  the  people 
taking  the  test.  In  criterion- 
referenced  instruction  and 
testing,  a  level  of  proficiency 
that  is  appropriate  for  a  given 
task  is  defined,  and  the  attempt 
Is  made  to  train  everyone  until 
they  reach  that  level.  If  some¬ 
one  cannot  reach  the  criterion, 
then  that  person  must  be 
disqualified,  or  the  trainer 
must  seek  alternative  methods 
of  training  the  person. 
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The  expression  "Cri¬ 
terion-Referenced  Instruc¬ 
tion1'  (CRl)  has  also  been 
used  by  Robert  F.  Hager 
and  Refer  Pipe  in  the  tit¬ 
le  of  a  sef  of  copyrighted 
materials  on  the  system¬ 
atic  approach  to  instruc¬ 
tional  development.  Since 
these  materials  are  copy¬ 
righted,  and  since  there 
are  other  similar  sets  of 
materials  for  sale  by 
competing  publishers, 
thelp  tables  and  flow¬ 
charts  are  not  included 
here.  However,  since 
these  materjals  are 
avai loble  fo  many  of 
you  as  a  result  of  par¬ 
ticipating  in  the  CRl 
workshop,  it  may  be 
useful  to  see  a  corn- 
par  I  son  of  CRl  wi th 
ISD.  This  comparison 
I  1 1 ustrates  both  the 
diversify  and  the  com¬ 
monality  of  the  two 
instructional  devel¬ 
opment  models.  The 
major  phases  are 
d i f ferent ,  but  they 
both  include  com¬ 
parable  steps. 


ISD 

PHASES 

COMPARABLE 

STEPS 

CRl 

PHASES 

- 

A 


na[yze 


DESIGN 


DEVELOP 


IMPLEMENT 

CONTROL 


HEEDS  ANALYSIS 


TASK  ANALYSIS 

SPECIFY  OBJECTIVES 

PREPARE  TESTS 

SELECT  STRATEGY 
(OR  INSTRUCTION¬ 
AL  MANAGEMENT 
PLAN) 

DEVELOP  INITIAL 
VERSION 

TRY  OUT 

REVISE 

VALIDATE 

IMPLEMENT 

MONITOR,  EVALU¬ 
ATE  AND  REVISE 


ANALYSIS 


DESIGN 


IMPL 


*MEMT 


A  Final 

Caution.  We  must 
emphasize  again 
that  there  is  no 
one  best  mode  I . 
The  ISD,  and  TEC 
Contract  develop¬ 
ment  models  all 
have  one  goal: 
to  provide  guid¬ 
ance.  None  of 
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them  can  provide  prescriptive 
rules  which  will  govern  all 
problems  that  will  occur. 

The  models  can  provide  gen* 
eral  principles  of  systematic 
development  and  some  specific 
procedures.  They  cannot  cover 
every  specific  instructional 
problem  that  may  be  encount¬ 
ered.  Your  understanding  of 
the  basic  principles  is  nec¬ 
essary,  and,  as  in  all  areas 
where  judgment  is  important, 
some  experience  with  the  pro¬ 
gram  will  help  you  fulfill  the 
goal  of  hi gh-qual i ty  TEC  ma¬ 
terials  . 
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U.  S.  Army  Training  and  Doctrine  Command,  August  1975-  (Provides 
overview  of  ISO  model.) 
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2.1,2  OVERVIEW:  How  TEC  lessons 
are  Developed  and  Eva  I ua  ted 


hitioduc-tion.  The  general 
process  of  TEC  Lesson  development 
and  evaluation  is  given  below. 

It  is  assumed  for  convenience 
here  that  all  the  indicated  steps 
(except  Reproduction  and  Distri¬ 
bution)  take  place  within,  or 
are  monitored  by,  the  TRADOC 
School  Directorate  of  Training 
Developments  (DTD),  which  is 
further  assumed  to  include  the 
TEC  Management  Branch.  If  your 
School  differs  from  this  assump¬ 
tion,  translate  the  words  used 
to  fit  your  organization. 
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DEVELOPMENT 

PHASE 


Develop  initial  instructional  materials 
|  Conduct  test  on  individuals,  revise  as  necessary' 

(Small  group  tests  (optional),  revise  as  cpie:>sar\ 

t  \ 

Large  Group  Validation,  revise  as  necessary 
Approve  final,  camera-ready,  kits 


REPPODUCT | ON 
PHASE 


Reproduction 


D i s tr i but  ion 


tnont-hnd  Phene..  The 
first  major  step  in  TEC  lesson 
development  normally  will  occur 
independently  of  a  decision  to 
produce  TEC  lessons.  This  is 
the  definition  of  a  specific 
training  requirement  for  sol¬ 
diers  in  one  of  your  proponent 
MOSs.  The  decision  to  produce 
a  TEC  lesson  to  meet  this  require 
ment  depends  upon  the  need  to 
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export  the  training  and  the 
stability  of  the  lesson  ma¬ 
terial.  The  determination 
of  the  training  requirement 
is  usually  a  function  of  the 
Task  Analysis  and  Design 
Division  in  DTD. 

This  division  is  gen¬ 
erally  responsible  for  the 
job  analysis  necessary  to 
develop  job  tasks  for  the 
Soldier's  Manuals.  These 
analyses  result  in  defin¬ 
ition  of  the  performance  re¬ 
quirements  of  each  critical 
task.  These  critical  tasks 
are  then  translated  into 
training  objectives.  This 
js  a  highly  critical  step 
in  training  development 
since  the  validity  of  these 
tasRs  (truthful  represen¬ 
tation  of  the  real  job  re¬ 
quirement)  and  training 
objectives  dictate  the  maxi¬ 
mum  extent  to  which  any  train 
ing  material  can  be  effective 
in  training  to  do  the  real 
job. 


FRONT  -  END  PHASE 

•  TRAINING  REQUIREMENTS 

•  JOB/TASK  ANALYSIS 

•  CRITICAL  TASKS 

•  TRAINING  OBJECTIVES 

•  TRAINING  MODE 

•  TERMINAL  LEARNING  OBJECTIVES 

•  VALIDATION 

•  STUDENT  ENTRY  LEVEL 

h 

•  LESSON  LENGTH 
§  CCSS  AND  GEM 


After  cri  t  ical  task  per¬ 
formance  requirements/train¬ 
ing  objectives  have  been 
defined,  these  are  normally 
turned  over  to  the  Course 
Development  Division  or  sim¬ 
ilar  organization,  This  group 
is  then  responsible  for  cre¬ 
ating  training  materials  to 
train  to  the  objectives.  It 
is  normally  at  this  point  that 
the  decision  is  made  qn  whether 
to  develop  materials  through 
TFC  or  other  instructional 
means.  This  decision  may 
well  depend  on  the  difficulty 
of  the  material,  the  require¬ 
ments  for  exportabi 1 i ty ,  and/or 
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TERMINAL  LEARNING  OBJECTIVES 

•  SPECIFIC  STATEMENTS  OF: 

-  KNOWLEDGES 

-  SKILLS 

-  PERFORMANCE  CAPABILITIES 

•  PERFORMANCE  REQUIREMENTS 
t  CONDITIONS 

t  CRITERIA/STANDARDS 


the  judged  adaptability  of  the 
training  requirement  to  one  or 
more  of  the  available  TEC  media. 

If  the  decision  is  to  go  to  TEC, 
the  TEC  Management  Staff  is  in 
the  act  for  real .  Then  the  sub¬ 
sequent  steps  given  in  the  TEC 
cycle  are  performed  (or  moni¬ 
tored)  by  this  group.  In  case 
of  contractual  lesson  develop¬ 
ment,  all  of  these  steps  are 
monitored  and  evaluated  by  the 
TEC  Staff  in  relation  to  satis¬ 
fying  the  requirements  for  Govern¬ 
ment  Furnished  Materials  (GFM) 
and  the  Coordination  and  Contract 
Summary  Sheet  (CCSS)  which  are 
to  be  developed  by  the  TEC  Staff 
and  provided  to  the  contractor. 
Development  and  monitoring  of 
these  materials  and  activities 
are  discussed  in  subsequent  sec¬ 
tions.  This  section  will  discuss 
the  steps  as  they  should  be  con¬ 
ducted,  regardless  of  whether 
in-house  or  by  contract. 

Given  the  training  objec¬ 
tive  (TEC  stated  in  specific 
performance-oriented  terms), 
the  Course  Deve lopers/TEC  staff 
begin  their  part  of  the  front- 
end  process.  This  part  requires 
several  essential  steps  in  re¬ 
lation  to  overall  TEC  development. 

The  first  step  in  this 
part  of  the  process  is  to  trans¬ 
late  the  training  objectives 
into  terminal  learning  objec¬ 
tives  for  the  TEC  lesson.  These 
are  specific  statements  of  the 
knowledges,  skills,  and  performance 
capabilities  that  the  trainee 
should  process  upon  completion 
of  the  lesson.  To  the  extent 
possible,  these  learning  objec¬ 
tives  should  be  the  performance 
capabilities  and  skills  necessary 
to  actually  do  the  soldier's  task 
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toward  which  the  lesson  is 
directed.  Ideally,  these 
learning  objectives  are  the 
performance  requirements, 
plus  the  condi tions  under 
which  the  performance  must 
be  accomplished,  plus  the 
cr j ter  ion,  or  standard,  which 
the  trainee  must  meet  in  his 
performance  after  training. 

It  may  be  obvious  to  point 
out  that  the  learning  objec¬ 
tives  may  be  identica]  to 
the  training  objectives 
which  may  be  identical  to 


the  Job  task.  If  the  train¬ 
ing  objectives  fill  the  bill 
for  learning  objectives,  don't 
Change  them.  If  they  are  in¬ 
appropriate  or  incomplete, 
change  them  to  meet  the  need. 


As  indicated  above,  the 
validity  of  the  training/ 
learning  objectives  is  highly 
critical  to  the  successful 
training  of  the  soldier  to 
perform  his  job  |n  the  field. 
Hake  sure  these  are  correct 
and  directly  related  to  what 
the  soldier  really  must  be 
able  to  do. 


The  development  and  val¬ 
idation  of  the  criterion  ref¬ 
erenced  test'  items  is  also  a 
highly  critical  step  in  TEC 
lesson  development  and  evalu¬ 
ation-  The  most  important 
aspect  is  whether  the  test 
items  accurately  and  reliably 
measure  what  you  want  to  meas¬ 
ure  --  and  this  again  is 
based  on  what  the  soldier 
needs  to  be  able  to  do  on  the 
job.  Pre/posttpst (s)  (there 
nay  he  either  ope  or  two 
equivalent  tests)  are  to  be 
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developed  from  the  criterion- 
referenced  lest  items  and  val¬ 
idated  so  that  they  accurately 
measure  the  ability  of  the 
soldier  to  perforn  the 
tasks  he's  being  trained  to  do. 
Ideally,  this  should  be  a  per¬ 
formance  test  which  requires  the 
soldier  to  actually  perform  the 
required  activities.  Frequently, 
it  is  difficult  or  impossible 
to  deiign  such  a  test  which  can 
be  feasibly  administered  within 
the  training  conditions  and  time 
constraints.  In  such  cases 
"performance-oriented"  tests 
which  combine  some  performance 
components  with  some  written 
components  may  have  to  be  sub¬ 
stituted  for  a  "hands-on"  per¬ 
formance  test.  In  either  case, 
these  tests  should  be  validated 
through  testing  both  experienced/ 
trained/knowledgeable  soldiers 
(masters)  and  inexperienced/ 
naive  soldiers  (non-masters) 
and  determining  whether  the  test 
really  tests  the  mastery  of  the 
tasks  to  be  trained.  If  the 
test  is  valid,  it  should  dis¬ 
criminate  between  the  "Masters" 
and  the  "Non-masters."  If  it 
does  not,  two  alternatives  are 
possible:  either  it  is  not  a 
valid  test  of  the  performance 
task;  or,  the  task  is  one  which 
does  not  require  training.  If 
the  ]atter  is  true,  you've  saved 
yogr  School  some  time  and  effort. 
If  the  former  is  true,  you've  got 
more  work  to  do  on  test  develop¬ 
ment  and  revalidation  of  the  test. 
Thjs  process  is  discussed  further 
in  Chapter  5  of  this  manual. 

Again,  this  is  a  highly  critical 
step  in  TEC  lesson  development, 
since  if  the  test  is  poor,  the 
lesson  may  be  training  the  wrong 
skills  or  not  training  to  the 
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level  required  to  actually 
perform  the  task  on  the  job. 
Developing  the  actual  lesson 
is  an  iterative  process  which 
includes  much  of  the  Develop¬ 
mental  and  Reproduction  Model 
with  which  you  may  be  already 
somewhat  familiar.  This  is 
the  most  time  consuming  part 
of  the  tota]  development  pro¬ 
cess,  but  from  one  viewpoint 
it  |s  the  jeast  critical 
st’p  jh  the  pfocess.  It  is 
essentially  a  systematic 
trial  and  error  process  which 
iteratively  evaluates  the  ef¬ 
fectiveness  of  the  instruc¬ 
tional  materials  in  reiation 
to  the  criterion  test  items 
developed  in  Step  2.  Success¬ 
ful  performance  of  this  step 
will  pss.ure  fhat  the  TEC  lesson 
teaches  to  t^e  test.  But  re¬ 
member,  it  is  the  quality  of 
the  test,  and  of  the  iearning/ 
tralnjng  objectives  which  it 
measures,  that  determine  the 
effectiveness  of  the  instruc¬ 
tion  jn  relation  to  tne  re-1! 
world  performance  of  the 
soldier  on  real  world  tasks. 

No  matter ■ how. good  the 
Instruction  js,  if  it  is 
training  to  an  inadequate 
test,  or  to  meet  incorrect 
training  objectives,  it 
may  be  worse  than  worthless; 
it  may  be  dangerous! 

Jhe  remaining  steps 
in  the  front-ond  phase  are: 

•  Determine  the  entry  ievel 
of  trainees,  including 
prerequisite  knowledges 
and  skills  they  must  b,  ing 
to  the  lesson. 

•  Determine  the  structure 
and  format  for  the  lesson, 
including  what  type  of 
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medium  is  most  appropriate, 
how  long  it  must  be,  whether 
more  than  one  kit  will  be 
required,  etc. 

•  Prepare  the  Coordination  and 
Contract  Summary  Sheet  (see 
Chapter  3)  and  any  additional 
GFM  that  may  be  necessary. 


V&v 2,topme.nt  Phcu>c.  As 
shown  in  the  TEC  cycle  there  are 
several  general  sub  steps  in  the 
lesson  development  phase.  These 


include : 


•  Develop  the  initial  instruc¬ 
tional  materials  for  the  lesson 
these  include  the  script,  the 
visuals  (if  audiovisual,  printed 
text,  or  job  performance  aid), 
the  Lesson  Administrative  In¬ 
structions  (LAI),  and  the  Student 
Instruction  Sheet  (SIS). 

•  Conduct  individual  tests  of  the 
lesson  instructional  materials. 
This  is  the  first  step  in  demon¬ 
strating  training  effectiveness 
of  the  lesson.  It  yields  data 
op  the  quality  of  the  initial 
cut  at  the  training  materials. 

•  Revise  TEC  materials  as  indicated 
by  individual  trials. 

•  Conduct  optional  small  group 
tests  of  the  lesson  material s . 
Again,  designed  to  yield  diag¬ 
nostic  information  about  the 
lesson's  effectiveness. 


•  Revise  TEC  materials  as  indicated 
by  small  group  trials. 

•  Conduct  validation  tests  with 
large  groups  (approximately  30 
trainees)  or  with  sequential 
sampling  approach  (cf.  Chapter  5). 


•  Revise  TEC  materials  as 
indicated  bv  large  group 
trjals. 

Please  note  that  steps 
2  through  7  can  be  recycled, 
individually  or  totally,  if 
any  test  results  indicate  the 
need  for  it. 

Once  the  revised  TEC 
materials  have  been  demon¬ 
strated  to  effectively  teach 
to  the  criterion  level  de¬ 
manded  based  on  the  Importance 
of  fhe  training  objectives 
(see  Chapter  5).  the  TEC  les¬ 
son  is  ready  to  be  prepared 
in  final  form, 

As  the  final  step  in  the 
development  phase,  the  TEC 
Manager's  staff  is  respons¬ 
ible  for  technical  review  of 
the  camera-ready  kits. 


Reproduction  Phcu>e. 
Finally,  in  either  in-house 
or  contractual  development, 
the  kits  (in  $  Master  Kit  for¬ 
mat)  are  forwarded  for  repro¬ 
duction-  After  reproduction, 
copies  are  forwarded  to 
Tobyh^pna  Army  Depot  for 
distribution. 


REPRODUCTION  PHASE 
•  REPRODUCTION 
t  DISTRIBUTION 


2  2  RELATIONSHIP  BETWEEN  TEC, 

ISO,  AND  DIRECTORATES  OF - - 

TRAINING  DEVELOPMENT 


As  we  indicated  in  Section 
2.1  . 1  ,  you  are  not  ordinari ly 
responsible  for  the  entire  de¬ 
velopment  process.  Most  schools 
ar6  now  organized  so  that  the 
TEC  program  receives  the  inputs 
it  needs  for  the  design  and  de¬ 
velopment  of  TEC  lessons.  This 
lias  not  always  been  the  case, 
and  it  may  still  be  a  problem 
in  some  schools.  At  this  point, 
we  present  an  example  of  the 
relationship  between  the  ISD  and 
the  TEC  Manager's  responsibilities. 
Section  2.1.1,  an  example  from 
the  U.S.  Army  Transportation 
School,  illustrates  this  relation¬ 
ship. 


2.2.1  Summary  of  the  ISD  Phases 

Related  to  TEC  Development 


To  help  you  understand  how 
ISD  and  the  TEC  program  are  re¬ 
lated,  your  particular  areas  of 
concern  as  a  TEC  Project  Officer 
ore  discussed  below: 

•  PHASE  I  (Analyze)  -  Task  Analy¬ 
sis  at  the  U.S.  Army  Transpor¬ 
tation  School  is  the  respons¬ 
ibility  of  the  Individual 
Training  Analysis  and  Design 
Division,  Directorate  of  Train¬ 
ing  Developments.  The  outputs 
of  Phase  I  which  you  will  work 
with  are  a  task  listing,  train¬ 
ing  site  selection,  and  job 
task  data  cards.  The  job  task 
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data  cards  especially  will 
provide  a  good  basis,  with 
the  assistance  of  subject  mat¬ 
ter  experts,  for  the  preparation 
of  learning  objectives  and 
test  items. 

PHASE  II  (Design)  -  In  the 
case  of  TEC  lessons,  Phase 
II  functions  will  be  per¬ 
formed  by  you  and  your  sub¬ 
ordinates.  Your  major  out¬ 
puts  for  this  phase  will  be 
learning  objectives,  self- 
evaluation  criterion-refer¬ 
enced  tests,  and  minimum 
standards  to  be  used  dur¬ 
ing  lesson  validation  trials. 
These  items  are  incorporated 
in  a  document  referred  to  as 
the  Coordination  and  Contract 
Summary  Sheet  for  each  TEC 
lesson.  These  outputs  and 
the  summary  sheet  are  dis¬ 
cussed  in  further  detail  jn 
other  sections  of  this  Pro¬ 
ject  Officer's  Guide. 

PHASE  |ll  (Develop)  -  In 
the  case  of  TEC  lessons, 
the  majority  of  the  functions 
will  be  performed  by  a  con¬ 
tracted  lesson  developer, 
based  on . Schoo 1  specifications 
in  tfie  Coordination  and  Con¬ 
tract  Summary  Sheets  and 
related  documents.  The 
contractor  is  efforts  will 
be  monitored  by  the  TEC 
Branch.  The  primary  out¬ 
put  of  this  phase  will  be 
a  School -approved ,  validated 
TEC  lesson  prepared  for  dis¬ 
tribution  to  the  field. 

PHASE  IV  (Implement)  -  In 
the  case  of  [EC  lessons  used 
in  non-resident  settings,  as 
most  lessons  will  be,  the 
responsibility  for  imple¬ 
mentation  rests  in  effect 
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with  the  trainee's  commander  or 
supervisor.  As  for  TEC  lessons 
used  ip  a  resident  setting,  the 
responsibility  for  this  function 
would,  of  course,  rest  with  the 
department  having  proponency  for 
instruction  in  the  given  MOS. 

You  will  not  be  involved  with 
this  phase.  . 

•  PHASE  V  (Control)  -  Re¬ 
sponsibility  for  this  phase 
usually  belongs  to  the  Dir¬ 
ectorate  of  Evaluation  (DOE). 

You  may  eventually  be  con¬ 
cerned  with  feedback  on  the 
effectiveness  and  validity 
of  TEC  lessons  as  a  result 
of  functions  pei  foiiiied  by 
the  DOE. 


2.2.2  Relationship  Between  the 


Many  Directorates  of  Train¬ 
ing  Development  have  reorganized 
or  modified  their  organization 
to  facilitate  a  process  oriented 
training  development  cyc)e  such 
as  that  described  in  the  1SD. 

In  most  schools,  there  is  a 
Training  Analysis  and  Design 
Division  which  Is  sometimes  sub¬ 
divided  into  two  divisions  for 
individual  and  collective  train¬ 
ing.  As  the  title  indicates, 
this  division  covers  the  first 
two  phases  of  the  ISD.  This 
group  is  responsible  for,  among 
other  things,  preparing  a  task 
analysis  and  training  objectives. 
These  will  be  used  by  you,  and 
other  groups  within  the  Course 
Development  Division,  during 
the  development  phase,  which  is 
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Phase  1 1  I  of  the  I SD.  It 
is  tf"' ,  that  in  some  schools, 
the  TEC  Manager  does  not  have 
a  separate  unit  within  the 
Course  Development  Division, 
but  this  tends  to  be  the  ex¬ 
ception  rather  than  the  rule. 
The  fourth  phase,  Implemen¬ 
tation,  is  the  responsibility 
of  the  various  unit  commanders 
that  utilize  TEC,  but  the 
fifth  phase,  Control,  is  us¬ 
ually  the  responsibility,  at 
least  in  part,  of  the  Direc¬ 
torate  of  Evaluation. 


2.3  PLANNING  REQUIREMENTS 
AND  TECHNIQUES 


PLANNING  REQUIREMENTS 

•  SELECTING  SUBJECT  AREAS 

•  PLANNING  BUDGET 


Planning  is  an  important 
aspect  of  your  job.  Without 
planning  you  will  not  be  able 
to  accomplish  your  goals,  and 
ATSC  will  not  be  able  to  antic¬ 
ipate  your  requirements.  This 
section  is  designed  to  intro¬ 
duce  you  to  some  of  your  planning 
responsibilities.  Your  Project 
Officer  is  always  willing  to 
help  you  with  specific  questions 
or  problems. 


2.3.1  Select i ng  Subject  Areas 

for  TEC  Lesson  DeveToprren t 


During  this  stage  of  your 
work,  you  will  have  to  coordinate 
with  the  Training  Analysis  and 
Design  Division,  and  the  Course 
Design  Division.  Your  Training 
Analysis  and  Design  Division 
should  have  a  list  of  critical 
tasks  and  training  objectives 
that  track  with  the  Soldier's 
Manual  and  SQT  tests.  In  order 
to  select  the  jobs  to  be  developed 
in  TEC,  you  will  need  to  use  the 
criteria  that  have  been  approved 
by  ATSC/TPD.  These  criteria  tend 
to  stay  the  same,  although  the 
order  of  importance  may  change  in 
a  given  year.  You  would  use  these 
criteria  in  conjunction  with  the 
review  and  decision  procedures 
that  have  been  established  at 
your  school.  You  should  consider 


BUDGET  FLAMING 


prom  tine  to  time,  let¬ 
ters  will  be  sent  to  you  from 
ATSC/TPU  requesting  your  school 
internal  funding  requirements 
to  support  the  TEC  program. 

You  should  be  prepared  to  sub¬ 
mit  requests  that  provide  for 
the  continuance  of  your  current 
load,  and  projections  for  the 
next  two  fiscal  years.  Fund¬ 
ing  needs  should  be  listed  in 
the  fiscal  year  during  which 
they  wMl  actually  occur. 

For  example,  if  a  contract 
is  awarded  in  April,  print 
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requirements  will  probably  not 
occur  until  the  following  fiscal 
year.  Therefore,  funding  re¬ 
quests  for  print  support  should 
be  requested  for  the  following 
fiscal  year.  In  the  following 
portions  of  this  section  are 
guidelines  concerning  ATSC/TPD 
policies  regarding  internal  fund 
ing,  a  sample  of  the  format  to 
use,  a  brief  description  of  Ele¬ 
ment  of  Expense  (EOE)  numbers, 
ancj  an  example  from  the  Quarter¬ 
master  School . 


PoZicZzA .  As  a  general  rule, 
ATSC/TPD  will  fund  school  requests 
for  such  items  as  printing,  travel 
incidental  to  lesson  validation 
(assume  three  lessons  validated 
per  TDY  trip),  travel  incidental 
to  contractor  coordination  and/or 
lesson  quality  control,  shipment 
of  TEC  materials,  supplies  re¬ 
quired  for  ATSC  approved  in-house 
TEC  lesson  development,  and  mis¬ 
cellaneous  materials  required  to 
support  quality  control  of  TEC 
lessons  at  the  school.  Schools 
arp  required  to  give  a  brief  jus¬ 
tification  for  all  expenditures 
requested . 

As  a  TEC  manager,  you  will  be 
required  to  submit  TEC  funding 
data  to  your  resource  management 
office  for  inclusion  in  the  instal 
lation  budget  reports  to  TRADOC. 
Examples  of  this  would  be  the 
Budget  Manpower  Guidance  (BMG) , 
and  Budge.t  Execution  Review  (BER) . 


BUDGET  PLANNING 


The  format  for  school 
submission  of  funding  require¬ 
ments  wjli  be  a  letter  of  trans¬ 
mittal  that  includes  a  summary 
sheet  indicating  funds  request¬ 
ed  by  Element  of  Expense  (EOE) 
number.  An  example  of  the 
format  for  a  funding  request 
is  given  below.  As  backup 
material  to  the  summary  sheet 
discussed  above,  each  separ¬ 
ate  line  item  within  a  given 
EOE  f°r  which  funds  are  re¬ 
quested  must  contain  written 
justification.  Example  jus¬ 
tifications  for  each  EOE  are 
included.  For  example,  if 
five  separate  items  are  re¬ 
quested  under  the  EOE  for 
supplies,  each  of  the  five 
items  must  be  justified. 

ATSC/TPD  cannot  approve  the 
expenditure  of  funds  that 
are  not  directly  related  to 
the  TEC  program.  Questions 
on  funding  submissions  are 
to  l>e  directed  to  your  ATSC/ 


FORMAT  FOR  THE  REPORT 


(SCHOOL  LETTERHEAD) 

(or-  to:  symbol/ last  name  ai.v  rank  or  isprvpmt,  submitting) 

SUBJECT:  Fit  TEC  Funding  Request 


(DATE  SUBMITTED) 


ELEMENT  OF  FSTENSE 


EOE  DEFINITION 


fOE  2(00 


EOE  2200 


EOE  2100 


Travel  anil  Transportation  of  People 
Transportation  of  Things 


Rents  and  Comunlrarinns 


FOE  2400 


EOE  2500 


Printing  and  Reproduction 
Contract!  al/Purchas»d  Services 


EOE  2600 


EOE  3100 


Supplier  and  Materials 
Equipment 


All  Other  Funding  Requests 


f  i’*.l  t  lol'S 


n  t inn  i. .ii 

in..  1  lull's  YhY  dots  fur  lesson  vailrl  u  lun,  contra. tor 
co.it dinat  inn ,  attend  ni.tu  at  TEC  managers  conf ere*.  es 
and  any  oilier  tmv.il  (civilian  or  military)  ilia:  is 
justifiable. 

Cspcnicti  out  Iclpatml  In  shlpnunt  of  CI'll  to  cant  not  am, 
shipment  of  at  t  and/nt  i.l|lpoent  of  any  other  cupoilvo 
and/or  equipment  related  to  TEC  tlut  can  l.o  full/ 

Just  If  led . 

Iiunt.il  of  <'ii:u|. ntor  terminals,  Eorox  nu'liiins, 
coo.' nnl cot  Inns  equipment  or  any  orhei  equi  pe.er.t 
and/or  servlet-.,  rulatod  to  TEC  that  can  to  fully 
jUst  If  led . 

Printing  of  l.esson  Administrative  Instruction  Jib 
Aids,  adjunctive  materials,  an)  any  utlior  printed 
oatter  needed  t  >  support  TEC  lesson  production  or 
ut i 1 1  rat  Ion. 

Any  contractual  servicer;.  fn-nerally  sshiiil..  uj..  ..  it 
leave  an  entry  In  this  line  item  since  ATS'i  trill 
dot  err.  I  no  all  l  midi  up.  required  for  actual  contra' :  log 
of  TEC  lessons.  If  eliools  determine  tor.'  type  f 
additional  contracting  Jti  needed,  It  should  he 
entered  In  this  EOF  column  and  fully  Justified. 

Purrlnsc  of  ad  juact  Ive  materials  soli  as  protractors 
or  any  other  nitc-rialu  requlrej  to  support  TEC.  lessens 
tjiat  am  not  classified  ad  printed  natter.  Also 
Included  in  this  line  (ten  are  materials  requited  to 
support  i  lie  r.i-li  i  Is  Intertill  TEC  stuff  such  as  paint 
n.iterl  it..  I  r  In-  tnnuiv  ppe  hKeil  TEC  lessons. 

Equip..i  n  i.  ,  .  .  .ry  for  product  l.ui  it  TfcC  lessons  nr 
qualltj  i.ti.it  i  |.  Where  regulations  require  Just li iedt fun 
nf  th.  pm  eh  t.i.t.s,  the  school  tui.it  lull cute  whether 
the  ri'.|tiirt  il  nppruv.il  to  |.uy  the  equipment  hua  !  .,  a 
secured  through  proper  military  channels  or  what  stabe 
the  request  for  approval  is  In.  Ad  lit  ion  *  1  ly,  the 
school  must  provide  written  Justification  concerning 
why  the  equipment  should  In  purchased  under  the  TEC 
program. 

If  111!  school  I  eels  I  hot  e  Is  Just  If  I  utlo.i  tor  t  e 
op.  udlturcu  nf  lunds  t h  it  cannot  I  t*  spec i  t  lea!  ly 
llsti.ll  In  oue  wf  the  above  I'OEs,  hut  Is  r  I  lie.,  to  the 
TEC  program,  the  uxpcnilture  shnil.l  lie  listed  1:  tnis 
colimn  and  fully  Jn :t I f led. 


Ma steA  Schoo 


pEi'AKf:u::rr  <*r  'flit.  An:n 

U.S.  Array  Quartermaster  School 
Fort  Lee,  Virginia  23601 


15  April  1976 


ATEfl-TD-Cl) 

SUBJECT!  •  AMS  TF.C  0|vrntipt  Cofits.,  IY  71.  //,  U 


Con.-nandii  f 

II. S.  Array  Training  Support  Center 
ATTN:  ATT3C-TP-PU 
Fort  Egptls,  VA  73601 


1,  Reference  lottnr,  Cmnhat  Anns  Training  Iturd  (AinX-'ili-i'J) ,  dated  33  M.irrli  1976, 
subject:  School  Internal  Funding  Rr.|iilri-iii.  nts  to  Simjiott  tie  1>:iliil«(!  Extension 
Course  (TEC)  Program. 

2.  Attached  at  inclasures  1-3  are  tl  i[Ma  |.rnj  cLcd  intctu.il  funding  requlremeutd 
for  FY  71’,  IT  77  onl  FY  H  In  navi .1 . .slrli  tin  geld  lima  In  relnicn.  1  above. 

It  should  be  noted  that  there  are  no  .i|  hn.iiii-.-a  i  .i|>  for  it-iiu.i  revisions  and 
reprinting  of  support  ts.ttcriols.  In  the  over- changing  supply  arena,  this  will 
eontinu*  to  increase  the  war  Hand  and  IntuMial  fuiiding  rupiirei  i  at  s. 

fOK  THE  COMMANDANT! 


.  .just-- 
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V,  S.  Army  Quartermaster  Schcol 
Tort  lee,  Virginia.  23231  ’ 


AT3:<-T3-CD/nSHCT,  C?t 


SOOJECT:  FT  7t  TEC  Funding  Request 


ELEMENT  OF  :xP£ilSE 
EOE  2100 
EOS  22CO 
ECE  i.400 
EOS  2600 


EOS  QSrTVTTION' 


Travel  ami  Transportation  cf  People 
Transportation  cf  Things 
Printing  rnd  Reproduction 
Supplies  and  Materials 


15  April  1576 


ars-.-  Eso'.':srs3 


$1^,520 


TOTAL  FV  77  SSQtTSX 


$16, 027 


IQS  1120(TEY) 
CSS T{ NATION 


San  rr~">ttsco,  CA* 


Ex?c:rarrras  jooTincAircM 


resposs 

Coordinate  Larson 
Davelopn-nt  with 
Ccntraccnr 


kihoer 

.FsOPLE 


e£?.t~;  or  ssT:v.urg 

STAY  (DAYS)  COST  ' 


ECS  ^03  (Transportation  of  Things) 

a.  $!\lprent  of  lilsirarical  Eata  far  21  ICC  lessons,  total  uaight  oi  approximately  25  pa  -ends  per  lesson  with 
tsrUjtcd  costs  ot  H50. 

b.  IJjlpr.eat  or  (.espon  (Administrative  Instructions,  I'crkbeoUs ,  lesson  Hooks  sr.d  learning  Recourse  Casks  or 
5  Icifons  (551-101-7920  through  551-101-7532),  total  of  approximately  2  million  sages  as  estimated  costs 
of  2UC3. 


rcc  ftOO  (Pristine) 

IE330T  NnaSR 

551-]01-7'J23  through 
551 - iQ 1—7  932 


FC F  2600  (Supplies  and  Katnrialn) 


KMCntAL  TO 
EC  PJUN7T3 

IAX,  Workbook, 
lesson  Books, 
learning  resource  Earks 


".SlbtATCO 

PACES  : 

'Jo.  cf  panes 
anJ  cap! is  per 
concent  urkncv.n 
at  this  time. 
Estimated  2  rillicn. 
print  units 


estimated 

P7TXTI?:"  CCrTS 
511.520 


n.  Self-Service  supplies  in  support  of  TEC,  estimated  cast  5250. 

b.  Packing  notarial*  required  to  ship  historical  Data  end  printed  Material  ts  LEAD.  ZotL— tri  costs  ci  5100. 


- -.ca;.— — - - r - -  |  n  | ,  i  j 


2.4  SUBJECT  MATTER  EXPERTS 


rj 


You  may  have  some  know¬ 
ledge  of  the  content  areas  for 
which  you  are  developing,  but 
neither  you  nor  your  contrac¬ 
tor  wi  1  I  have  sufficient  con¬ 
tent  knowledge  for  the  devel¬ 
opment  of  Ccjch  lesson.  There¬ 
fore,  you  will  have  to  rely  on 
the  assistance  of  subject  mat¬ 
ter  experts  (SMEs) .  Different 
schools  use  the  SME  in  differ¬ 
ent  w^ys,  but  all  schools  agree 
that  the  primary  function  of 
the  SME  i s  to  check  the  TEC 
lesson  for  technical  accur¬ 
acy.  In  some  cases,  the  SME 
is  used  to  check  for  doctrinal 
accuracy*  or  to  assist  in  vari¬ 
ous  aspects  of  front-end  work 
or  lesson  development.  Re¬ 
gardless  of  the  variety  of 
ways  Ip  which  the  SME  is  used 
at  your  school,  the  critical 
task  of  the  SME  is  to  check 
for  the  technical  accuracy 
of  the  TEC  lesson. 


2.4.1  Utilization  of  Subject 
Hatter  Experts 


Schools  have  found  that 
SMEs  and  their  "chiefs"  do 
not  always  agree  on  what  con¬ 
stitutes  a  "technically  accur¬ 
ate"  lesson.  They  may  have 
differences  of  opinion  about 
the  procedures,  the  nomen¬ 
clature,  or  the  level  of 
detail  in  the  art.  Therefore, 


« -  -  •  •  •  r- 


P  .  »  V  '  w .  » 
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2.4  SUBJECT  MATTER  EXPERTS 


You  may  have  some  khow- 
Icuge  of  the  content  areas  for 
which  you  are  developing,  but 
neither  you  nor  your  contrac¬ 
tor  will  have  sufficient  con¬ 
tent  knowledge  for  the  devel¬ 
opment  of  each  lesson.  There¬ 
fore,  you  will  have  to  rely  on 
the  assistance  of  subject  mat¬ 
ter  experts  (SMEs).  Different 
schools  use  the  SME  in  differ¬ 
ent  ways,  but  all  schools  agree 
that  the  primary  function  of 
the  SME  is  to  check  the  TEC 
lesson  for  technical  accur¬ 
acy.  In  some  cases,  the  SHE 
is  used  to  check  for  doctrinal 
accuracy,  or  to  assist  in  vari¬ 
ous  aspects  of  front-end  work 
or  lesson  development.  Re¬ 
gardless  of  the  variety  of 
ways  |n  which  the  SME  is  used 
at  your  school,  the  critical 
task  of  t|ie  SME  Is  to  check 
for  t!:e  technical  accuracy 
of  the  TEC  lesson. 


2,4.1  Utilization  of  Subject 
flatter  Experts 


Schools  have  found  that 
SMEs  and  their  "chiefs"  do 
not  a | ways  agree  on  what  con¬ 
stitutes  a  ^technically  accur¬ 
ate"  jesson.  They  may  have 
differences  of  opinion  about 
the  procedures,  the  nomen¬ 
clature,  or  the  level  of 
detail  in  the  art.  Therefore, 


it  is  important  to  determine  who 

'or 


the  lesson  and  to  include  them 
early  to  eliminate  subsequent 
changes  based  on  their  biases. 


This  tendency  to  have  dif¬ 
ferent  opinions  about  what  a 
"technically  accurate"  lesson  is 
causes  problems  wnen  you  have 
turnover  in  SMEs.  It  is  best  if 
you  can  have  the  same  SME  work 
with  a  given  lesson  until  it  is 
finished.  Since  you  may  not  al¬ 
ways  be  able  to  do  this,  you  may 
have  to  face  the  task  of  breaking- 
in  g  new  SME  on  a  lesson  that  is 
already  under  development.  One 
way  of  helping  to  remove  per¬ 
sonal  bias  from  the  SME's  de¬ 
cision,  is  to  discuss  the  dif¬ 
ferences  between  "technical 
acceptability"  and  "personal 
style."  Most  experts,  unless 
they  are  extremely  closed-minded, 
will  recognize  that  there  is  more 
than  one  way  to  get  a  job  done, 
even  though  they  like  the.r  way 
best.  By  encouraging  the  new 
SME  to  make  this  distinction, 
you  might  be  able  to  save  yourself 
some  revision  time  and  money. 

The  pew  SME  might  get  a  chance  to 
show-off  his  style  in  a  subsequent 
lesson. 


2.4.2  Limitations  of  the  SME 


While  a  good  SME  can  be  in¬ 
valuable,  it  is  also  important  to 
realize  that  SMEs  have  inherent 
limitations.  Quite  a  number  of 
years  ago,  job  analysts  discovered 
wligt  they  celled  the  "master  work¬ 
er  fallacy."  It  was  traditional 
to  define  a  job  by  analyzing  the 
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work  of  a  master  worker.  Some 
one  finally  pointed  out  that 
even  a  master  worker  may  not 
he  doing  a  job  as  efficiently 
or  effectively  as  it  could  be 
done.  Even  this  person  is 
limited  by  his  own  personal 
experience  and  biases.  The 
sane  principle  holds  true 
with  SHEs.  They,  like  the 
rest  of  us,  tend  to  over¬ 
generalize  from  personal 
experience,  and  to  keep  doing 
something  the  same  way  it 
has  worked  once.  Therefore, 
it  might  be  appropriate  in 
some  situations  to  obtain 
input  from  more  than  one  SME 
on  a  given  lesson.  You  will 
discover  how  dramatically 
different  the  responses  of 
several  SHEs  to  a  given  in¬ 
structional  task  can  be. 

It  would  then  become  the 
task  of  yourself,  one  of  your 
project  officers,  or  one  of 
your  SMEs  to  help  untangle 
purely  stylistic  differences 
from  substantive  differences 
in  the  responses  of  the  dif¬ 
ferent  SMEs. 


RtCURRJfJG  REPORTS 


■2.5  RECURRING  REPORTS 


This  section  contains  descrip¬ 
tions  of  the  recurring  reports  that 
are  required  of  you.  Whenever  pos¬ 
sible,  a  reduced-s i zed  copy  of  the 
form  is  included  to  assist  in  rec¬ 
ognition.  If  you  need  instructions 
or  an  example  of  a  completed  copy 
of  any  of  these  forms,  please 
contact  your  ATSC/TPD  PO. 


2. 5.1  DAVIS  Reports:  DP  Form 

1995 


Putpoia.  The  DD  Form  1995 
is  used  to  program  information 
into  the  Defense  Audiovisual 
Information  System  (DAVIS). 

DAVIS  can  help  to  guard  against 
duplication  of  effort  by  several 
schools.  Duplication  is  a  common 
problem  due  to  the  overlapping  of 
TEC  lesson  material  among  schools. 
All  programmed  lessons  for  produc¬ 
tion  in  various  formats,  TV,  TEC, 
etc.  will  be  listed  in  the  com¬ 
puter  files  so  schools  are  aware 
oi  productions  underway  in  a 
given  subject  area. 


Rc.qnViC.d  B(J.  The  following 
require  the  filing  of  DAVIS  reports: 

•  AR  103-2,  1  September  1975. 

•  Letter,  ATTSC-TP-TEC ,  U.  S. 

Army  Training  Support  Center, 

22  September  1975,  subject: 
Completion  of  DD  Form  1995 
for  the  Defense  Audiovisual 
Information  System. 
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rite, 
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•  Letter,  ATTSC-TP-TEC, 

7  December  1976,  subject: 
Input  to  the  Defense  Audio 
visual  Information  System. 


RECURRING  REPORTS 


2.5-2  Qua r  ter ) y  TEC  Produc t_ 

Requ  i remen t ,  RCS  ATTNG- 

55 


PiUipo-Sd.  At  the  beginning  of 
FY  77,  Installation  Commanders 
signed  "Installation  Contracts" 
with  the  Command  Group,  Headquart¬ 
ers,  TRAOOC  .  The  contracts  out¬ 
lined  specific  numbers  of  pro¬ 
ducts  to  be  completed  during  FY  77 
The  TEC  Program  was  included  as  a 
major  area  of  interest.  Total 
TEC  Products  to  be  delivered  were 
listed  and  then  subdivided  into 
quarterly  delivery  schedules. 

RqqaOidd  Vuj.  Let  ter  TRADOC  , 

1  March  1977,  subject:  Quarterly 
TFC  Product  Requirements,  RCS 
ATJMG-55. 


2.5.3  TF.C  Pi  rect  Obligations^ 


PlVipO' S 0  .  These  reports  are 
absolutely  necessary  in  order  to 
facilitate  the  continued  funding 
of  school  support  for  the  manage- 
mcnt/ndmin i strat ion  of  the  TEC 
Program.  This  point  was  driven 
home  at  th(  May,  1977  TEC  Managers 
Conference.  ATSC/TPD  needs  to  be 
able  to  claim  unobligated  funds  in 
order  to  use  them  whore  they  are 


Only  non-TRAOOC  schools  are  required  to  report  TEC  Direct  Obligations. 


RECURRING  Rfc PORTS 


needed  before  they  are 
lost  at  the  end  of  a  fis¬ 
cal  year.  Should  you  |ose 
any  funds  due  to  their  being 
recalled  by  ATSC/Tf'D,  they 
will  be  replaced  when  needed 
In  the  next  budget  cycle. 
Only  with  your  cooperation 
can  TEC  funds  be  most  effec¬ 
tively  utilized.  There  is 
po  particular  format,  ex¬ 
cept  to  report  by  Element 
of  Expense  (COE) . 


Requited  Bij.  The  fol¬ 
lowing  references  should  lie 
Consulted  for  TEC  Direct  Ob¬ 
ligations  reports: 

•  Reference  paragraph  7, 
Memorandum  for  Record, 

TEC  Manager's  Confcrenre, 
19-22  October,  1976;  and 
letter,  TRADOC,  30  De¬ 
cember  1976:  subject: 

TEC  Direct  Obligations 

FY  77. 

•  Budget  Manpower  Guidance 
(BMG)  narrat i ve. 


air  cj  iz Hi/m 
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PuApoAC.  These  re¬ 
pot  ts  are  used  by  the  school 
to  provide  the  developing 
and  reproduction  contrac¬ 
tor  (s)  with  the  cchool's 
evaluation  of  kits  at  vari¬ 
ous  stages  of  development. 
These  reports  either  approve 
the  contractor's  work  or 
identify  deficiencies  that 
must  he  corrected  before 
the  school  authorizes  the 
contractor  to  proceed  to 
the  next  stage  of  devel¬ 
opment  . 


ReqiuSiP.d  B ij.  During 
the  November  197^  TEC  Man¬ 
ager's  Conference,  the  schools 
were  provided  wi  th  the  basic, 
format  for  lesson  review 
correspondence. 


tA *~L£  •  avi*. w  i  r.i 
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_ T E C  L cs son  Annuo] 

Rev i ew  Reports 


PuApoA e .  These  reports  are 
used  to  notify  the  Training  Support 
Center  of  the  results  of  annual  re¬ 
views  and  request/recommend  actions 
to  update,  revise  or  recall  fielded 
lessons . 


RdcpuAc.d  atf.  U  SAT  SC  Letter: 
Letter  of  Instruction  for  Conduc¬ 
ting  Annual  Review  of  TEC  Lessons, 
2  May  1977;  requests  that  you  re¬ 
view  TEC  kits  year  1 y  . 


SAMPLE  FORMAT 


SCHOOL  HEAD  INC 


OFFICE  SYMBOL 


SUBJECT;  Annual  Review  of  TEC  Kit  000-000-0000-F 


US  Array  Training  Support  Center 
ATTN:  ATTSC-TP-TEC 
Port  Euatln,  VA  23604 


1,  (Indicate  date  kit  va*  reviewed  and  by  wliori.) 

2,  (Indicate  result  of  review,  Extetislv,  rh.ingca  may  l-c  listed  ur 
Inclosure.  Changes  sliould  bn  listed  frame  by  frame.) 

3,  (Include  recorajendat  Ion  on  method  of  revision,  if  necessary.) 
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IP 


Compos ?  te  Task  Li st 
Update  Reports 


PitApoid.  The  Composite 
Task  List  Is  a  reference  document 
,that  identifies  evepy  task  taught 
in  fielded  TEC  lessons.  In  ad¬ 
dition,  the  Composite  Task 
List  indicates  tasks  that  are 
being  addressed  ;n  les  ons 
currently  being  developed  hy 
schools  and  tasks  that  schools 
plan  to  include  in  TEC  lessons 
that  they  will  develop  in  the 
future.  The  Composite  Task 
List  enables  course  designers 
to  determine  if  TEC  lessons 
can  be  used  to  support  course 
objeptives  in  addition  to  pro¬ 
viding  training  material  de¬ 
velopers  a  document  that  can 
he  used  to  determine  if  TEC 
lessons  should  be  referenced 
in  products  such  as  the 
Soldier's  Manual.  The  Com¬ 
posite  Task  List  also  assists 
schools  in  avoiding  duplicating 
tasks,  in  their  TEC  lessons 
that  are  or  will  be  covered 
by  anpther  school . 

With  these  reports, 
you  should  report  changes 
to  the  basic  Composite  Task 
List.  There  is  no  partic¬ 
ular  format  that  you  have  to 
f o 1 1 ow . 


ReqiU'ied  8</.  letter, 
USACATB,  8  March  1976, 
subject:  Composite  Task 
List;  requires  you  to  report 
changes  when  they  occur. 
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•REPARATION  FOR  TEC 
LESSON  DEVELOPMENT 
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TEC  LESSON  PREPARATION 


3.0  PREPARATION  FOR  TEC 
LESSON  DEVELOPMENT 


PREPARATION  pOR  LESSON 
DEVELOPMENT 

I 

e  KNOW  INSTRUCTIONAL  THEORY 

•  CARRY  OUT  SPECIFIC  PRO¬ 
CEDURES  OF  TEC  PROCESS 


The  TEC  development  system 
gives  you  a  proven  method  of  ef¬ 
fective  lesson  development.  This 
chapter  summarizes  what  you  have 
to  learn  in  ordei  to  do  your  job 
as  a  TEC  manager.  Along  with 
this  guidebook  you  will  need 
TRADOC  Pamphlet  350_30  Inter- 
service  Procedures  for  Instruc¬ 
tional  Systems  Design  (espec¬ 
ially  important  is  the  Executive 
Summary)  and  the  TEC  contract 
model  under  which  you  will  be 
work i ng . 

A  new  TEC  officer  wi  1 1 
quickly  find  that  he  must  make 
a  number  of  decisions  on  TEC 
lesson  development.  He  must 
know  some  instructional  theory 
(a  set  of  basic  principles)  and 
carry  out  specific  procedures 
required  of  the  TEC  process. 

The  purpose  of  this  chapter  is 
to: 

*  Provide  a  brief  overview  of 
the  basic  principles  as  ap¬ 
plied  in  TEC  lesson  develop¬ 
ment  . 

•  Describe  and  furnish  exam¬ 
ples  of  techniques  and  pro¬ 
cedures  used  by  TEC  (nanagers 
and  developers  in  lesson  de¬ 
velopment. 


BASIC  PRINCIPLES 


3.1  OVERVIEW  OF  THE  BASIC 
PRINCIPLES 


The  purpose  of  this  over¬ 
view  is  to  fill  the  immediate 
need  of  ncw)y  assigned  TEC 
Officers.  It  covers  the 
concepts  of  performance- 
oriented  training  as  ap¬ 
plied  to  TEC.  Since  these 
principles  drive  TEC  de¬ 
velopment  preparation,  a 
summary  of  "TEC  logic" 
should  give  you  a  feel 
for  (he  thinking  behind 
TEC  lesson  development. 

For  a  full  description  of 
the  development  process, 
you  should  refer  to  the 
latest  contractual  flow 
diagram/event  description 
and  the  ISD  model  (see 
Chapter  2) . 


When  the  focus  is 
on  preparation  for  de¬ 
velopment,  everything 
comes  from  the  principle 
of  performance-oriented 
training.  The  TEC  man¬ 
ager  should  understand 
the  critical  relation¬ 
ships  of  task  analysis, 
audience  characteristics, 
and  cr i ter  ion- referenced 
testing  to  training  ob¬ 
jectives.  These  are  the 
concepts  and  procedures 
that  al low  TEC  to  rise 
above  the  traditional 
methods  of  instruction. 
They  are  the  reasons 
why  performance-oriented 
instruction  makes  sense. 


c  f.'y 
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3.1.1  Performance-Oriented 


framing 


The  goal  of  every  TEC  lesson 
is  that  upon  completion  of  the 
lesson  the  soldier  has  a  skill 
that  be  can  perform.  Traditional 
instruction  analyzed  the  content 
of  instruction.  Performance 
tr.iining  looks  at  what  the  soldier 
must  do.  The  emphasis  is  shifted 
away  from  knowledge  and  toward 
performance.  The  soldier  must 
perform  or  TEC  fails! 

Through  TEC  the  training 
materials  themselves  do  the 
teaching.  More  accurately,  les¬ 
sons  are  designed  to  help  the 
soldier  teach  himself.  Both  the 
learning  characteristic  of  the 
soldier  and  the  task  that  make 
up  the  job  (the  MOS  duty  position) 
are  purposely  built  into  the  TEC 
lesson.  These  elements  focus  on 
final  soldier  performance.  What 
that  performance  is  and  how  it 
is  to  be  measured  are  stated  in 
the  training  objectives  and  their 
criterion-referenced  tests. 


Swezey,  R.  W.  &  Pearl  stein,  R.  B.  Guidebook  for  developing  criterion 
referenced  tests.  Arlington,  Virginia:  U.  S.  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences,  August  1975. 
(AD  AO  1 4  987)  (Chapter  I  discusses  criterion-referenced  testing 
and  how  it  relates  to  performance  measurement.) 


3.1.?  Job/Task  Analysis  vs 

T raining  task  Ana  I  ys  i  o_ 


In  Chapter  2  you  were  intro¬ 
duced  to  jcb/task  analysis.  This 
section  briefly  covers  task  anal¬ 
ysis  from  the  point  of  view  of 
training  task  analysis.  The 
job/task  analysis  is  the  pri¬ 
mary  input  into  training  task 
anal ys I s . 

A  job/task  analysis  i s 
a  logjcal  description  of  the 
duties,  tasks,  and  elements 
that  make  up  an  MQS  duty  po¬ 
sition.  The  logical  break¬ 
down  of  these  tasks  is  not 
necessarily  the  way  the  sol¬ 
dier  will  most  effectively 
learn  to  perform  the  tasks. 
Training  task  analysis  takes 
the  tasks  selected  for  train¬ 
ing  and  structures  them  in 
ways  that  help  the  soldier 
master  the  performance  of 
those  tasks.  Often,  how¬ 
ever,  the  job/task  analysis 
and  the  training  task  anal¬ 
ysis  approximate  each  other 
so  clqsely  that  the  two 
are  i pterchangeabl e .  Ex¬ 
perienced  developers  gen¬ 
erally  use  the  term  "task 
analysis"  to  refer  to  both. 

They  assume  the  context  of 
the  conversation  makes  it 
clear  as  to  whether  lie  is 
referring  to  job  analysis 
or  training  task  analysis. 

«  i 

Qccass iona 1 1 y  you  may 
need  to  clarify  the  point  of 
reference  in  a  discussion: 

"Now,  are  we  talking  about 
task  analysis  with  respect 
to  the  job  or  to  the.  train¬ 
ing  objectives?"  The  dif- 
fei epees  between  the  two 
are  given  below. 


JOB/TASK 

ANALYSIS 


TERMINAL  TRAINING  ORJtXTIl'C  Itr'-.r  .n-^t-sritr.Ui/ 
tpisli.  i-'k.rif.ur.  c,  si»  ,;tUn  •  l«*rr<  •»  1*  t<*  ««- 
Miit  i'-:i  tr*inii^/k<A’.«*  tl,»  fc-il*  t-r.  u-.1r.- 

whiCIi  th#  rclion  will  pifLCt/Sll  *S  thn  tilfti" 

ii  1*  fr  tXiiLT.ua  v.f.  rust  ti  fricr.ed/d'tecYly 
rtUlii  ts  jc&  jtrfr.T-ln  :r. 

LEARNING  OLjrrTIVE  -cryr ntr.-.  ef  « 
lerr.'-j;  ’.ri.rlif,  Cb.itesiv»/'fu':ri*r 
di/Uillt  ir.it  c'-cps/nrc  trsticur- 
i»Uet  tt  lnriin.il  Truin'r..'  Cbjet- 
•ivt*  --  *  tiona,  rcr.Jitlcns, 
Htn.Tidt. 

LEARNING  STEP  Des- 

crirlion  of  sil  rcrpon- 
#nit  r*craarry  to 
lt-arfi  tp  pvrfoirz 
tt»  Lt.irn.rf, 
Objcctiv*. 


8 ibtiog'taphtj  ho>i  3.1 . 2_ 

Department  of  the  Air  Force.  Handbook  for  designers  of _ i  nstruct ional 

systems:  Task  analysis  (Vol  .  II,  AFP  50-58)  .  Wash  i  ngton ,  D.  C.  : 
Headquarters,  United  States  Air  Force,  July  1373-  (Provides  a 
complete  description  of  task  analysis.) 

Tracey,  W.  R.,  Flynn,  E.  B.,  6  Lcgerc,  C.  L.  J.  The  development  of  in¬ 
structional  systems:  Procedures  lanual.  Fort  Devens,  Mass.: 

United  States  Army  Security  Agency,  1970-  (Contains  a  section  on 
task  analysis.) 

TRADOC  PAMPHLET  350“ 30 .  I  SO  Phase  I .  Fort  Monroe,  Virginia:  U.  S.  Army 
Training  and  Doctrine  Command,  August  1975-  ( Pp .  1-112  discuss 

task  analysis. ) 


•,i  .*  ■ 


„ _  ...  m.  -  *-  ^  *  -  V^"'  aAa.Ta  1*-*  a-  iJL  JW  Af  *.  - 


3-6 


r  f 


TEC  lesson*  are  intended  for 
very  specific  audiences:  soldier/ 
trainee.s.  These  audiences  are  the 
target  population  of  the  TEC  lesson. 
Since  the  target  population  is  go¬ 
ing  to  function  as  a  leatner,  the 
lesson  must  be  geared  to  the  in¬ 
struct  ional ly  relevant  learning 
characteristics  of  the  typical 
sold ier/trainee  for  whom  the  train¬ 
ing  j$  intended.  This  chapter  pre¬ 
sents  general  audience  consider¬ 
ations  while  Chapter  A  (See  Section 
h.l.3)  gives  you  sepcific  methods 
for  determining  the  target  aud¬ 
ience  parameters  of  the  lesson 
material.  The  Army  has  found 
that  age,  rank,  MOS,  educational 
background,  and  months  in  service 
are  useful  descriptors  of  the 
target  population.  There  is  a 
growing  body  of  educational  re¬ 
search  on  how  learner  and  task 
characteristics  influence  one 
another.  Instructional  develop¬ 
ers  find  it  helpful  to  list 
audience  characteristics  in  a 
number  of  categories.  The  most 
often  researched  categories 
relevant  to  training  are 
given  below. 


CATEGORIES 

PHYSICAL 

APTITUDES 

SK  l_LL  S_ 

• 

AGE 

•  IQ 

• 

JOB-RELATED 

• 

SEX 

•  VERBAL 

SKILLS 

• 

HANDICAPS 

ABILITY 

• 

EXPERIENCE 

OR 

«  SPATIAL 

STRENGTHS 

ABILITY 

• 

DEXTERITY 

KNOWLEDGE 

SOCIAL 

ATTITUDES 

0 

EDUCATIONAL 

*  WORK  ENVIRON- 

• 

HOT  1  VAT  1  ON 

LEVEL 

ME  NT 

• 

INTEREST 

• 

READING 

»  PEER  REFERENCE 

• 

BIASES  AND 

LEVEL 

GROUP 

PREJUDICES 

• 

MATHEMATICAL 

•  SOCIOECONOMIC 

© 

ANXIIIY 

BACKGROUND 

STATUS 

LEVEL 

The  research  is  fine,  but 
in  the  real  world  of  TEC  devel- 
of  men  t  la  rye  files  of  psycho¬ 
metric  data  on  attitudes  and 
abi  li  ties  for  individual  IIOSs 
is  not  available  (and  never  will 
be).  There  is  another  way  to 
effectively  define  and  limit 
the  taryet  population  --  course 
prerequ i s i tes . 

Course  prerequisites  help 
you  ensure  that  you  tlo  not  try 
to  train  those  who  are  riot  ready 
for  the  TEC  lesson.  You  do  not 
want  soldiers  taking  TEC  lessons 
that  go  far  beyond  their  present 
knowledge  or  skill.  The  soldier 
must  have  acquired  the  prerequisite 
skills  through  other  TEC  lessons, 
courses,  or  OJT  to  be  able  to 
master  the  new  material. 

Course  prerequisites,  as  all 
training  development  requirements, 
come  from  a  performance  perspective. 
What  must  the  soldier  be  able  to 
do  before  be  can  optimally  learn 
from  the  new  lesson.  In  this 
way  the  course  prerequisites  force 
the  attention  of  the  TEC  manager 
and  developer  on  entry  performance. 
They  also  take  into  consideration 
the  broader  perspectives  on  how 
the  TEC  lessons  fit  together 
and  into  the  total  training  and 
management  system. 

Course  prerequisites  as  de¬ 
veloped  for  the  Lessons  Adminis- 
trative  Instructions  (LAI s )  are 
covered  in  Chapter  6.  The  aud¬ 
ience  characteristic  wi 1 1  be 
listed  on  the  title  page  of  the 
Cf.SS  to  aid  the  developing  con¬ 
tractor  laying  out  the  Kit  Design 
Approach  (KDA) .  The  target  aud¬ 
ience  characteristics  will  influence 


the  developer's  decisions 
on  the  amount  of  material 
to  be  covered,  the  medium, 
the  level  of  language  to  be 
used,  the  learning  strategy, 
and  the  starting  point  of 
the  lesson.  You  should 
supply  the  ranges  for 

•  Formal  education 

•  Months  of  military  service 

•  Grade/rank 

•  Primary  sources  of  military 

tra ?n i ng 

•  Prjor  training  or  experience 

with  lesson  subject  matter 

-  MOS  training  (school  based) 

-  OJT 

-  TEC  lessons  prerequisites. 

|n  section  3-3,  the  CCSS 
title  page  reflects  a  useful 
set  of  audience  descriptions 
for  lesson  development.  It 
describes  who  the  trainee  is 
with  respect  to  the  training 
task. 


3.1.4  Training  Objectives 


For  TEC,  the  Front-End  Phase 
(see  Chapter  2)  should  now  pro¬ 
duce  a  compact  and  instructional ly 
relevant  statement  --  the  TRAINING 
OBJECTIVE.  The  training  objective 
is  a  clear  and  explicit  performance 
statement  built  on  three  elements: 
(a)  the  task;  (b)  the  conditions; 
(c)  the  training  standard.  Look 
at  the  following  example  given 
below. 


DEFINITION 


LXAHPLE 


TASK: 


•  THE  TASK  TO  BE  PERFORMED  IS 
IDENTIFIED  IN  OBSERVABLE  TERMS. 
APPLYING  A  BATTLE  DRESSING  IS 
OBSERVABLE.  WE  CAN  SEE  THE 
SOLDIER  DO  IT. 


CONDITIONS: 

•  THE  CONDITIONS  ARE  STATED  UNDER 
WHICH  THE  SKILL  OR  KNOWLEDGE 
IS  DEMONSTRATED.  IT  TELLS  THE 
TRAINER  WHAT  RESOURCES  AMD  MA¬ 
TERIALS  MUST  BE  PROVIDED  FOR 
THE  SOLDIER/TRAINEE. 


TRAINING  STANDARD: 

•  THE  TRAINING  STANDARD  STATES 
THE  MINIMUM  STANDARD  OF  ACCEP¬ 
TABLE  PERFORMANCE  THE  STUDENT 
MUST  ATTAIN  TO  PASS  THE  TEST 
(PERFORM  ACCEPTABLY). 


•  THE  CRITERIA  ESTABLISHED  BY 

THE  TRAINING  STANDARD  ARE 
USUALLY: 

-  TIME 

-  COMPLETENESS 

-  ACCURACY 

-  SAFETY  STANDARDS  (IF 

REQUIRED). 

•  THESE  CRITERIA  ARE  FOUND  IN 

THE  JPM  (JOB  PERFORMANCE 
MEASURES)  OF  THE  TASKS  AS 
PART  OF  THE  WORK  OF  THE  TASK 
ANALYSIS  DIVISION. 


•  EACH  SOLDIER  WILL  APPLY  AN 
INDIVIDUAL  BATTLE  DRESSING. 


•  GIVEN  AN  INDIVIDUAL  BATTLE 
DRESSING,  A  SUBJECT  INDIVIDUAL 
(OR  PRACTICE  DUMMY),  AND  A 
NARRATIVE  DESCRIPTION  OF  WOUND 
LOCATION. 


•  DRESSING  MUST  BE  APPLIED  WITHJM 

2  MINUTES. 

•  DRESSING  MUST  BE  APPLIED  WITH¬ 

OUT  TOUCHING  (CONTAMINATING) 
STERILE  SIDE  OF  DRESSING. 

•  DRESSING  MUST  COVER  DESCRIBED 

WOUND. 

•  STUDENT  MUST  APPLY  PRESSURE  TO 

THE  WOUND  EITHER  WITH  THE  AT¬ 
TACHED  BANDAGES  OR  WITH  THE 
HAND  OVER  THE  DRESSING,  UNTIL 
IT  IS  DETERMINED  BY  THE  TRAINER 
THAT  BLEEDING  HAS  STOPPED. 

9  THE  BANDAGES  MUST  BE  WRAPPED 
AROUND  THE  DRESSING  AND  THE 
WOUNDED  LIMB  AND  TIED  SECURELY 
OVER  THE  DRESSING. 


Because  the  performance  in 
the  training  objective  is  ex¬ 
plicit,  there  is  less  debate 
about  what  the  objective  means. 
Because  the  objective  describes 
the  performance  with  action 
verbs,  rather  than  "mental" 
verbs,  such  as  knows,  under¬ 
stands,  is  proficient  in, 
there  is  a  great  deal  of 
common  agreement  about  what  is 
and  what  is  not  acceptable  per¬ 
formance  . 


PERFORMANCE -ORIENTED  TRAINING 
OBJECTIVES 

•  CLEARLY  STATED 

•  RESOURCES  EMPLOYED  EFFICIENTLY 

•  OBSERVABLE,  EXPLICIT  STATEMENT 

OF  PERFORMANCE 

•  SOLDIER/TRAINEE  ORIENTED 

•  CONTROL  THE  INTENT  OF  INSTRUCTION 
ft  REQUIRE  ACTION  VERBS 

•  MOST  STUDENTS  UNDERSTAND  WHAT  IS 

EXPECTED  OF  THEM  BY  SIMPLY  READ¬ 
ING  THE  TRAINING  OBJECTIVES 

•  "MEASURABLE"  TERMS  FOR  PERFORMANCE 
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3  •  1  .j> _ Criterion  -  Re  ferencod 

Test  i  ng 


CRITERION-REFERENCED  TESTING 

•  REQUIRES  A  TASK  ANALYSIS 

•  INDICATES  WHO  CAN  PERFORM 

a  task  to  acceptable  standards 

•  PROVIDES  DIAGNOSTIC  INFORMATION 


Criterion-referenced  tests 
ot  the  training  objectives  test 
the  object  i  ves--r>oth ing  more. 

They  nre  measures  of  whether  or 
not  tiie  soldier  performs  at  the 
level  cquired  of  the  objectives. 

Cr  i  ter ion-refei  enced  tests  are 
related  to  the  Job  Performance 
Measui es  (JPMs) ,  but  they  are 
prepared  in  much  greater  detail. 
Criterion-referenced  tests  tell 
the  soldier  exactly  what  he  is 
to  do  and  the  conditions  under 
which  he  is  to  do  it.  Although 
the  primary  purpose  of  the  cri¬ 
terion-referenced  test  is  a 
GO-NO  GO  decision  on  soldier 
performance,  the  test  must  also 
have  a  diagnostic  capability. 

That  is,  the  test  must  yield 
information  about  why  the  soldier 
failed  to  pass  the  test.  Con¬ 
sequently,  some  items  on  the 
test  may  be  purely  diagnostic 
ones,  testing  subordinate  skills 
or  functioning  as  indicators  of 
"trouble  spots"  in  some  of  the 
intermediate  objectives. 

Another  major  feature  of 
criterion-referenced  tests  is  test 
revision.  Criterion-referenced 
testing  usually  requires  several 
run-throughs  before  inconsistencies, 
confusing  points,  and  performance 
difficulties  can  be  eliminated. 

This  technical  problem  is  handled 
by  the  test  developers,  while  the 
TEC  manager's  responsibility  is 
to  ensure  completeness,  fidelity, 
and  realistic  rut-off  scores  that 
correspond  to  the  overall  training 
plan . 
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3.2  PREPARATION  TECHNIQUES 

AND  PROCEDURES  FOR  TEC  - 

LESSON  DEVELOPMENT 


In  Chapter  2  the  procedures 
were  covered  for  planning  the  TEC 
program.  After  subject  matter 
has  been  determined  and  approved, 
it  is  time  to  put  together  the 
GFM. 


3.2.1  How  to  Develop  Govern¬ 
ment  Fu rnisheri  Materials 
(GFM) 


The  GFM  consists  of  the 
Coordination  and  Contract  Sum¬ 
mary  Sheet  (CCSS)  and  all  rel¬ 
evant  equipment  and  materials 
needed  to  produce  the  lesson. 

GFM  is  not  a  hastily  thrown  to¬ 
gether  package  of  previous  train¬ 
ing  materials  and  field  manuals. 

The  TEC  manager  and  developer 
should  view  the  GFM  as  repre¬ 
senting  four  critical  dimensions: 

•  GFM  is  a  reflection  of  ser i ous 
training  needs  best  served  by 
exportable  training  and  de¬ 
termined  through  prior  needs 
anal ys i s . 

•  GFM  embodies  the  principles  of 
per formance-or i ented  instruction 
the  training  philosophy  of  the 
U.S.  Army. 

•  GFM  together  with  the  current 
contract  model  of  TEC  develop¬ 
ment  defines  the  conditions 
and  constraints  for  management 


decisions  that  guide  the 
lesson  development  process. 


•  CFM,  especially  the  CCSS, 
is  essentially  the  basis 
from  which  the  developing 
contractor  wt I  I  commence 
work. 

Incomplete  CCSS  and  other 
GFM  will  create  a  "fuzzy"  be¬ 
ginning  for  you  and  the  de¬ 
veloping  contractor.  It  is 
your  job  to  see  that  the  CCSS 
is  as  specific  and  detailed 
as  possible.  All  references 
should  document  page,  para¬ 
graph,  and  figure  numbers 
(when  applicable).  Contrac¬ 
tors,  often  unfamiliar  with 
the  content  of  the  TEC  lesson 
when  first  starting,  can  waste 
hours  going  through  a  large, 
detailed  manual  looking  for 
a  particular  item  of  infor¬ 
mation  that  has  been  refer¬ 
enced  by  document  number 
only.  Throughout  the  pro¬ 
ject  you  will  be  living 
with  the  CCSS.  The  CCSS 
will  be  guiding  the  devel¬ 
opment  of  the  TEC  lesson. 

A  conscientious  TEC 
manager  and  developer  and 
a  fully  competent  contrac¬ 
tor  can  and  will  solve 
many  problems  together. 

Theirs  can  be  a  stimu¬ 
lating  and  professionally 
rewarding  relationship. 

Each  brings  his  own  per¬ 
spective  and  expertise 
to  the  project.  Neither 
sloughs  his  duties  and 
responsibilities  off  on 
the  other.  A  new  TEC 
manager  may  overly  rely 


CAUTION! 


00  NOT  PUT  OrF  PROBLEMS 
WITH  EXPECTATION  THAT 
THE  CONTRACTOR  CAN  OR 
WILL  SOLVE  THEM  FOR  YOU. 
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on  the  advice  and  recommen¬ 
dations  of  a  contractor.  He 
may  feel  unsure  of  his  own 
"educational  expertise." 
That's  natural.  However,  if 
you  are  uncertain  about  the 
consequences  of  heavily  re¬ 
lying  on  a  contractor,  ask 
an  experienced  TEC  manager. 

He  has  often  learned  the  hard 
way.  The  contractor's  point 
of  view  is  not  always  in  line 
with  the  best  interest  of 
TEC. 


Many  of  these  problems 
can  be  avoided  with  a  clear 
and  precise  CCSS.  Developing 
the  GFH  is  the  real-world 
substance  of  TEC  development. 
It  anchors  TEC  to  the  Army's 
instructional  setting.  The 
following  sections  of  this 
chapter  provide  you  with  the 
techniques  and  procedures 
that  help  ensure  a  well -con¬ 
structed  CCSb  and  GFM  package 


GOVERNMENT  FlJKNJ  SHOD 
MATERIA l  S 


3.2,2  Lesson  Scope  and  Purpose 


The  goal  of  every  TEC  lesson 
is  to  produce  a  task  performer. 
Goal  statements  are  statements 
of  how  you  intend  to  rectify  a 
discrepancy.  That  is,  you  dis¬ 
tinguish  between  the  way  it  is 
now  and  the  way  i t  ought  to  be. 
Define  goals  in  terms  of  what 
is  and  what  ought  to  be. 

The  "what  is"  becomes  the  input 
of  the  TEC  lesson,  the  "what 
ought  to  be"  is  the  sought  for 
outpu  t . 


DEFINING  LESSON  GOALS  -  AH  EXAMPLE 


"WHAT  IS" 


"WHAT  OUGHT  TO  BE' 


INPUT 


OUTPUT 


Soldiers  in  M0S62B  at  Skill 
Level  2  perform  below  the  mini 
mum  proficiency  on  the  job  at 
the  following  tasks: 


Performance  levels  required  of 
M0S62B  Skill  Level  2  personnel 
are  that  they  arc  able  to  main¬ 
tain  the  following  standard  for 
the  following  tasks: 

1 . 

2. 

3- 


By  laying  out  the  broad  goal 
of  the  TEC  lesson  you  can  easily 
define  the  Scope/Purpose  of  the 
losson--a  requirement  of  the  CCSS. 
In  the  Scope/Purpose  statement  you 
tell  the  developer  who  the  target 
audience  is  and  what  skills  he 
should  be  expected  to  learn. 

The  Scope/Purpose  statement  is  not 
as  specific  as  the  training  objec¬ 
tives,  rather  it  tells  the  develop¬ 
er  in  a  general  way  what  the  lesson 
i  s  intended  to  do. 


Trai  n  jji£  C >b  ject  ives 


The  learning  steps  taken  to 
reach  the  terminal  training  objec¬ 
tives  is  an  often  debated  problem. 
Although  many  roads  lead  to  Rome, 
there  will  be  arguments  about 
which  is  the  best  road.  For  many 
tasks,  the  number  and  order  of 
learning  steps  offer  several  good 
possibi I i ties. 


DECISION  TREE  FOR  SEQUEt.CIJ.C  OBJECT  I Vt« 


Question; 

Is  the  re  I  at  on- 
snip  CEPENDEKT? 

(Does  the  learning 
of  one  require 
previous  mastery 
of  the  other? 


DEPCIiDFNI 
\  7  / 


►  logical 
sequcnc i ng 
i  s 

mandatory 


Sequencing  the  learning  steps 
within  each  training  objective  im¬ 
plies  a  rationale  for  the  realtion- 
ship  among  the  events  of  learning 
in  a  TEC  lesson.  The  decision 
tree  is  a  quick,  logical  way  to 
determine  sequencing  priorities. 


Quest  I  jn ' 

Is  thr  r e I  at  ion-  s 
ship  SUPPORTIVE?  V 

(Do  s  the  learning 
of  one  faci I i tatc 
the  learn  Ing  of 
another?  E*anplr: 
driving  a  car  aids 
in  learning  to 
drive  a  truck.) 


/SUP>X 
P0R1IVE 
v  ?  X 


transfer 

'  ^.nguencing 

(wire  difficult 
to  prew  Ide  cvl * 
dence  for.  try  to 
document  with 
previous  lessons, 
research  findings, 
jury  of  operts, 
etc . ) 


* 

INDEPENDENT 
rel  at  lonshi p 

Y^u  ha.c  rrany  possibilities  in  sequencing  independent 
elation jhips:  chronological  (performance)  ordering, 
r.o/elty  sequencing,  not  ivat  iono  I  ,  simple-complex,  etc. 
Experience  and  tr I  a  I -and-error  are  the  usual  methods. 
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Referenced  Tests 


Tasks  selected  for  train 
ing  come  from  the  MOS  task  list¬ 
ing.  These  tasks  along  with 
their  Job  Performance  Measures 
(JPM)  are  transformed  into 
t'aining  objectives.  The  criterion- 
referenced  tests  of  the  training 
objectives  would  ideal  1  >  be 
the  same  as  the  JPlis.  JPfls 
are,  however,  often  imprac¬ 
tical  as  the  TEC  criterion- 
referenced  tests  (CRTs)  be¬ 
cause  of  time,  resources, 
and  equipment.  Besides,  you 
cannot  expect  the  soldier 
after  initial  training  to 
perform  at  a  proficiency 
level  that  must  be  gained 
through  practice. 

Normally,  you  must  at¬ 
tempt  to  construct  a  post¬ 
test  that  approx i mates  the 
JPM.  Two  problems  arise 
with  cr i ter  ion- referenced  tests 
of  training  objectives:  the 
training  conditions  and 
training  standards.  Train¬ 
ing  conditions  differ  from 
real-world  conditions  by 
the  very  nature  of  the 
training  setting.  You  should 
try  to  make  these  conditions 
match  as  closely  as  possible 
the  conditions  the  soldier 
will  find  on  the  job.  The 
conditions  statement  in  the 
test  must  tell  the  soldier 
under  what  conditions  he 
must  perform  the  task. 

The.  standards  for  post- 
tests  arc  generally  lower 
than  the  standards  of  the 
JPMs.  When  first  learning 
to  perform  a  (ask,  the  trainee 


J U  UUJUiiJ  w; 


hove  a  lower  degree  of  profic¬ 
iency,  and  to  produce  a  less 
than  perfect  product. 

As  you  turn  the  traininq 
objectives  into  test  items,  you 
will  find  there  is  no  magic 
formula  for  determining  how  de¬ 
tailed  the  tests  should  he,  what 
standards  should  be  set,  and  how 
the  test  is  to  be  scored.  Test 
development  is  much  like  TEC 
lesson  development.  Experience, 
consensus,  trial -and-error  are 
primary  ingredients.  This  does 
not  mean  that  decisions  on  test 
construction  should  be  arbitrary. 

A  valuable  procedure  to  follow 
in  developing  CRTs  has  been 
produced  by  Swezey  and  Pearlstein 
for  the  Army  Research  Institute. 
This  practical,  applied  procedure 
significantly  improves  the  quality 
of  criterion-referenced  tests. 

The  flow  of  this  process  is  given 


•  ASSESS  THE  OBJECTIVES  AS 
INPUTS  INTO  THE  CRT 


PERFORMANCE 

CONDITIONS 

STANDARDS 


•  DEVELOP  A  TEST  PLAN 


PRACTICAL  CONSTRAINTS 
ITEM  FORMAT 
NUMBER  OF  ITEMS 


•  CONSTRUCT  THE  ITEM  POOL 


9  SELECT  FINAL  TEST  ITEMS 

9  ADMINISTERING  AND  SCORING 
THE  TEST 

9  MEASURING  RELIABILITY  AND 
VALIDITY 


-  MATCHING  WITH  THE  OBJECTIVE 

-  CLEAR  AND  UNAMBIGUOUS 

-  EASY  TO  ADMINISTER 

-  APPROPRIATE  LEVEL  OF  REALISM 

-  (SEE  CHAPTER  5) 

-  (SEE  CHAPTER  5) 


-  (SEE  CHAPTER  5) 


the  state-of-the-a r t  of  cri¬ 

terion-referenced  test  de¬ 
velopment,  refer  to  the  ISO 
(Phase  II  Design),  the  CRI 
Workshop  materials,  and 
Swezey  and  Pearlstein. 

The  pretest  (see  Chap¬ 
ter  5)  is  essentially  a  by¬ 
pass  of  instruction  for  the 
soldier  who  passes  it.  This 
test  determines  whether  the 
soldier  can  already  adequate¬ 
ly  perform  the  training  task 
or  some  sections  of  the  whole 
lesson.  It  is  a  waste  of 
time  to  train  someone  to  do 
what  he  already  knows  how 
to  do. 

The  pretest  is  designed 
to  test  precisely  what  the 
posttest  tests.  According 
to  the  ISO,  the  pretest  is 
generally  identical  to  the 
posttest  or  an  alternative 
version  of  that  test.  The 
ISD  (Phase  II  Design),  covers 
both  pro-  and  posttesting 
in  the  section  on  entry  be¬ 
havior. 
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When  developing  the  GFM, 
you  should  consider: 

•  time  and  cost  of  developing 
new  ma ter i a  1 s 

•  the  purpose  of  the  objectives 

•  the  requirements  of  the  con¬ 
tractor  for  detailed  technical 
i nforma  t  ion 

•  the  references  (documentation) 
in  the  CCSS. 


Til  1C.  and  Co6t.  Do  not  re¬ 
invent  the  wheel  .  Use  what  you 
have,  when  you  can.  Many  train¬ 
ing  materials  already  in  existence 
are  successful.  Inspect  for  their 
ability  to  meet  TEC  needs.  Check 
the  TEC  lesson  composite  task 
listing  and  the  TEC  monthly  status 
report  to  ensure  you  are  not  du- 
pl i eating  what  is  being  done  or 
has  been  done. 

Pu'ipoi a  oft  the  Objective -& . 

When  gathering  training  materials, 
focus  on  the  performance  of  the 
training  objectives.  When  you 
review  material s ,  ask  yourself  how 
the  information  relates  to  the 
training  objective.  If  the  infor¬ 
mation  is  a  technical  document,  is 
it  up-to-date?  Is  it  correct? 

If  the  materials  are  previous 
training  packages  or  plans  of  instruc 
tion,  are  the  content  and  method  of 
presentation  applicable  to  the  TEC 
lesson?  Is  it  capable  of  being 


ment  must  be  judged  on  its 
availability,  cost,  ease  of 
transportation,  and  inde- 
structabi 1 i ty .  Students 
can  be  very  hard  on  equip¬ 
ment  . 

R eqtuAcwct its  oj  if m 
Cot:  tnactvK.  Contractors 
generally  request  complete 
documentation  and  technical 
assistance.  The  GFM  must 
reflect  your  best  effort  to 
supply  all  relevant  mater¬ 
ials.  Otherwise,  you  wi 1 1 
constantly  hear  the  phrase, 
"Well,  we  don't  have  the  .  .  ." 

R CjjjcAe tico^  ( Poc.ttric.n- 
tation]  In ~UTc  "CCSS .  A 
sample  of  a  checklist  and 
reference  sheet  is  pro¬ 
vided  below  that  you  may 
wish  to  use  to  keep  track 
of  reference  soui ces  that 
you  have  located.  During 
the  development  process  a 
document  or  piece  of  equip¬ 
ment  that  was  originally 
deemed  irrelevant  may  be 
critical  at  a  later  date. 

This  work  sheet  for  logging 
sources  considered  for  the 
GFM  can  be  extremely  help¬ 
ful  in  retrieving  discarded 
materials. 


WHEN  YOU  REFERENCE  MANUALS  AMD 
DOCUMENTS,  CITE  PAGES ,  PARA¬ 
GRAPH  NUMBERS,  FIGURES,  ETC. 

BE  SPECIFIC.  NAIL  IT  DOWN  SO 
THAT  THE  CONTRACTOR  DOESN'T 
SPEND  EXCESSIVE  AMOUNTS  OF 
TIME  SEARCHING  FOR  THE  INFORMATION 
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Once  you  have  established 
the  exact  materials  to  be  issue 
to  the  development  contractor, 
it  becomes  necessary  to  prepare 
a  GFM  receipt  which  lists  those 
materials  issued  to  the  con¬ 
tactor.  To  accomplish  this 
schools  will  complete  ATSC 
Form  122,  dated  1  Nov  77, 

Loaned  Government  Owned 
Property  Receipt.  Special 
note  must  be  made  of  the  "‘lust 
Return"  and  "Expendable"  Col¬ 
umns.  For  each  item  of  GF/< 
or  GFE  (Government  Furnished 
Equipment)  you  must  indicate 
whether  the  material  is  to 
be  returned  to  the  school. 

The  receipt  must  be  signed 
and  dated  by  a  contractor 
representative  and  copies 
retained  by  the  school  and 
contractor.  Copies  of  ATSC 
Form  122  have  been  distri¬ 
buted  by  ATECP ;  however, 
schools  may  reproduce  this 
form  locally  after  initial 
supply  has  been  exhausted. 
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The  CCSS  is  a  critical  docu¬ 
ment  in  your  work  with  your  con¬ 
tractor.  The  quality  and  cost  of 
the  final  product  will  depend, 
to  a  great  extent,  on  the  quality 
of  the  CCSS.  The  purpose  of  this 
section  is  to  introduce  you  to 
the  purpose,  format,  and  content 
of  the  CCSS. 


3_.  3  .J _ The  CCSS  as  an _ I  ns  t  ruct  ?  ona  1 

Guide  and  Contract 


The  CCSS  is  port  of  the  GfM 
supplied  to  the  contractor  by  the 
TEC  Project  Officer.  As  you  de¬ 
velop  the  CCSS  the  critical  im¬ 
portance  of  all  of  the  front-end 
analysis  will  become  obvious.  The 
arduous,  time-consuming,  and  me¬ 
ticulous  process  of  defining  the 
audience,  working  with  the  task 
analysis,  developing  specific  train¬ 
ing  objectives,  and  compiling  criterion 
referenced  test  items  starts  to  pay 
off.  It  is  this  work  which  forms 
the  content  of  the  CCSS. 


3.3.2  Wi i ting  the  CCSS 


In  form,  the  CCSS  has  a 
title  page  and  one  or  more  pages 
explicitly  stating  the  training 
objectives,  the  criterion  referenced 


test,  the  responses  the  soldier 
will  make,  and  a  re  larks  sec¬ 
tion.  A  description  and  ex¬ 
planation,  as  well  as  an 
example  of  the  CCSS,  are 
given  below. 
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k.Q  DtSIGN  AND  ASSESSMENT  OF  TEC  LESSONS  — 


This  chapter  provides  human  factors 
and  design  information  you  need  to  moni¬ 
tor  and  evaluate  the  production  of  TEC 
lessons.  Since  TEC  can  be  developed 
either  in-house  or  by  a  contractor, 
these  criteria  can  be  followed  in  the 
in-house  production  cycle  or  used  in 
monitoring  and  evaluating  the  con¬ 
tractor's  development  effort.  Criteria' 
for  lesson  design  are  discussed  and 
methods  for  application  of  these  in 
lesson  assessment  are  presented. 


The  chapter  consists  of  three 
major  parts.  Section  A.  I  presents  de¬ 
sign  criteria  for  the  development  of 
all  or  several  TEC  lesson  types.  These 
criteria  comprise  media  selection, 
lesson  considerations,  self-evaluation 
design,  and  pictorial  level  of  detail. 
Sections  A. 2  thru  A.  5  present  special 
considerations  related  to  the  develop¬ 
ment  of  lessons  in  various  media. 
Finally,  Section  A.  6  discusses  how 
to  use  these  criteria  and  considera¬ 
tions  in  the  assessment  of  TEC  lessons, 
whether  developed  in-house  or  by  a 
contractor.  It  provides  checklists 
which  can  be  used  to  assess  the 
strengths  and  weaknesses  of  in¬ 
dividual  lessons.  This  assessment 
technique  should  be  used  as  a  diag¬ 
nostic  tool  to  improve  subsequent 
drafts  of  lesson  materials. 


Because  of  the  uniqueness  of  each 
TRAOOC  School,  this  chapter  presents 
only  the  major  considerations  of  how 
these  criteria  should  be?  incorporated 
into  your  development  process.  Appro¬ 
priate  references  and  cross-references 
are  provided  where  possible. 
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Additional  TEC  lesson  development 
requirements  can  be  found  in  the 
existing  TEC  contracts.  The  materials 
in  this  chapter  are  not  intended  to 
modify  or  negate  any  requirement  of 
the  existing  contracts,  but,  they  can 
help  you  in  monitoring  and  assessing 
the  products  of  the  contracts. 


As  a  TEC  manager  you  are  required 
to  actively  participate  in  TEC  lesson 
development  and  to  monitor  the  contrac¬ 
tor's  performance  for  contracted  develop¬ 
ments.  The  criteria  presented  in  this 
and  the  following  sections  are  intended 
to  assist  you  in  that  development  and 
monitoring  process.  This  chapter  should 
help  you  understand  how  the  available 
design  criteria  can  be  applied  in  de¬ 
velopment  and  assessment  of  TEC  lessons. 

Before  discussion  of  specific 
criteria  and  their  applications,  you 
should  understand  that  the  conscientious 
application  of  all  the  design  criteria 
in  the  world  cannot  assure  the  develop¬ 
ment  of  training  effective  TEC  lessons. 
Training  effectiveness  is  a  function  of 
several  things,  only  one  of  which  is  the 
technical  aspect  of  lesson  design. 

There  are  also  the  factors  of  having  a 
valid  measurement  instrument  (test), 
and  having  valid  and  meaningful  instruc¬ 
tional  materials  for  the  training 
sequence. 

On  the  other  hand,  without  appli¬ 
cation  of  the  best  technical  approaches 
to  lesson  development,  without  considera¬ 
tion  of  the  relationships  between  audio 
and  visual  modes  of  instruction,  and 
without  consideration  of  the  needs  of 
your  audience,  the  best  application  of 
the  other  factors  may  also  be  worthless. 
This  can  happen  because  the  intended 
audience  cannot  understand  the  lesson, 
or  because  they  are  bored  with  it,  or 
because  they  just  will  not  sit  and  en¬ 
dure  an  overly  lengthy  lesson,  or  be¬ 
cause  of  any  number  of  similar  reasons. 
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In  summary,  a  particular  TEC 
kit  or  lesson  can  fail  to  train 
effectively  due  to  either  poor 
design  or  inadequate  instructional 
techniques.  The  elimination  of 
the  poor  design  from  the  start 
can  give  your  instructional  tech¬ 
nology  its  best  chance  to  train 
effectively. 


J».l.l  TEC  Lesson  Media  Selection 


A  major  decision  in  the  TEC 
development  process  is  deciding 
which  medium  to  choose  for  lesson 
presentation.  Presently,  the  media 
available  for  TEC  lessons  are  audio 
visual  (AV) ,  audio  only  (AO),  and 
printed  text  (PT).  Future  TEC 
lesson  formats  may  also  include 
videodisc,  computer  assisted  in¬ 
struction  (CAI),  or  any  number 
of  new  delivery  systems. 

When  discussing  media  selec¬ 
tion,  the  new  TEC  manager  should 
keep  in  ini nd  there  are  two  types 
of  TEC  lessons:  teaching  lessons 
and  guidance  lessons.  Teaching 
lessons  are  formatted  in  one  of 
the  three  aforementioned  media 
and  are  designed  for  initial  or 
refresher  instruction  so  that 
soldiers  can  learn  to  perform 
particular  tasks.  Guidance  lessons 
called  Job  Performance  Aids  (JPAs) , 
use  a  checklist  or  "talk-through" 
format  to  assist  the  soldier  in  per 
formance  of  a  given  task  or  proce¬ 
dure.  Presently,  the  only  TEC 
medium  for  JPAs  is  printed  text 
(See  Sect  ion  ^l .  5)  • 


media  selection  concerns  the  mode 
of  information  presentat  ion,  j_.e. 
should  information  be  presented 
primarily  auditorily  (AO)  cr 
visually  (AV.PT)?  In  particular, 
does  the  material  require  visual 
support?  Can  it  be  easily  pre¬ 
sented  in  writing  only?  Or, 
is  an  auditory  mode  sufficient 
to  communicate  the  information? 
Factors,  such  as  those  following, 
should  be  considered  in  your 
cho i cc. 


USE  AUDITORY  MEDIUM  IF: 


USE  VISUAL  MEDIUM  IF: 


•  THE  INFORMATION  IS  SIMPLF. 


♦  THE  INFORMATION  IS  COMPLEX. 


THE  INFORMATION  IS  SHORT. 


»  THE  INFORMATION  IS  LONG. 


o  THERE  IS  NO  NEED  TO  CROSS- 
REFERENCE  THE  INFORMATION. 


©  THERE  IS  A  NEED  TO  CROSS- 
REFERENCE  THE  INFORMATION. 


THE  INFORMATION  DEALS  WITH 
EVENTS  IN  TIME. 


THE  INFORMATION  DEALS  WITH 
LOCATION  IN  SPACE. 


©  THE  INFORMATION  REQUIRES 
IMMEDIATE  ACTION. 


THE  INFORMATION  DOES  NOT 
REQUIRE  IMMEDIATE  ACTION. 


•  THE  RECEIVING  LOCATION  IS 

TOO  BRIGHT  FOR  AV  PRESENTATION 
OR  TOO  DARK  TO  PERMIT  READ¬ 
ING  OF  PRINTED  MATERIAL. 

o  THE  INDIVIDUAL  IS  REQUIRED 
TO  MOVE  ABOUT  CONTINUALLY. 

•  THE  TASK  REQUIRES  A  "HANDS- 
ON"  ACTIVITY  THAT  CAN  BE 
EASILY  DESCRIBED  WITHOUT 
VISUAL  IDENTIFICATION. 


•  THE  RECEIVING  LOCATION  IS 
TOO  NOISY. 

©  THE  INDIVIDUAL  CAN  REMAIN 
IN  ONE  POSITION. 

»  THE  TASK  REQUIRES  VISUAL 
INPUT  (c.([  ,  LOCATING 
SWITCHES). 

»  THE  TASK  REQUIRES  A  "HANDS- 
ON"  ACTIVITY  WHICH  MUCT  BE 
DEMONSTRATED  OR  ILLUSTRATED 


medium,  however,  y :>u  should  identify 
the  medio  alternatives  that  would 
be  suitable  to  effectively  teach 
the  TEC  lesson  objectives.  This 
process  provides  you  with  a  set  of 
candidate  delivery  systems  that  ex¬ 
cludes  all  the  inappropriate  systems. 
Using  the  table  below  will  provide 
some  yuidance  in  making  a  trade-off 
deci si  on. 


CHARACTERISTICS 

RELATIVE 

HIGH 

RANKING 

MEDIUM 

LOW 

Flexibility  in  Lesson  Design 

PT 

AV 

AO 

Student  Access 

PT 

AO 

AV 

Mobility  (Field  Use) 

PT 

AO 

AV 

Ease  in  Updating/Revisions 

PT 

AO 

AV 

Student  Interest/Motivation 

AV 

AO 

PT 

Inadequate  Reading  Skills 

AV 

AO 

PT 

Requires  Visual  Movement  Presentation 

AV 

PT 

AO 

Presentation  of  Pychomotor 

AV 

PT 

AO 

Preceptual  Skills 

Cost 

AV 

AO 

PT 

A  more  complete  and  systematic 
method  for  determining  the  most  appro 
priate  delivery  system  is  given  in 
1SD  (Block  I  I  I .2  ,  pp.  106-12*0  • 
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is  a  judgmental  decision  process  based 
on  practicality  and  cost  alternatives 
Several  factors,  like  those  discussed 
below  have  to  be  considered  when  re¬ 
jecting  media  formats. 


FACTORS  THAT  SHOULD  BE  CONSIDERED  IN  REJECTING  MEDIA  ARE: 

•  STATE-OF-THE-ART:  THE  BASIC  MEDIUM  IS  UNDER  DEVELOPMENT  OR  TEST 
AND  MAY  NOT  BE  INCLUDED  FOR  THE  TEC  PROGRAM. 

•  INTERFACE  WITH  EXISTING  PROGRAM:  TEC  LESSONS  MUST  BE  DESIGNED 
TO  FIT  Into  existing  PROGRAMS,  WHICH  places  CONSTRAINTS  on  the 
NEW  LESSONS:  e.q.,  EQUIPMENT  ON  HAND,  AVAILABLE  CLASSROOMS, 
SCHEDULING  PRACTICES,  ETC. 

•  TIME  TO  PRODUCE  MEDIA:  MEDIA  WHICH  REQUIRE  LONG  LEAD  TIMES  FOR 
DEVELOPMENT  MAY  NOT  BE  USEFUL  WHEN  SCHEDULED  READY- FOR-TRAINING 
DATES  DO  NOT  ALLOW  A  LONG  DEVELOPMENT  CYCLE. 

•  BUDGET  CYCLE  CONSTRAINTS:  WHILE  THE  APPLICATION  OF  SOME  OF  THE 
POWERFUL  TRAINING  APPROACHES,  SUCH  AS  CLOSED  CIRCUIT  TELEVISION, 
MAY  RESULT  IN  LOW  COSTS  PCR  STUDENT  GRADUATE,  THE  INITIAL  IN¬ 
VESTMENT  IS  SUBSTANTIAL.  UNLESS  THESE  RESOURCES  APPEAR  IN 
EXISTING  BUDGETS,  THE  APPLICATION  OF  THESE  TECHNIQUES  TO  AN 
IMMEDIATE  PROBLEM  IS  NOT  FEASIBLE. 

•  ADOPTION  OF  INNOVATIONS:  PROJECT  TEAM  MEMBERS  FREQUENTLY  RE¬ 
SIST  INNOVATIONS.'-  IF  THE  PROPOSED  MEDIUM  IS  SIGNIFICANTLY  DIF¬ 
FERENT  FROM  EXISTING  TECHNIQUES,  EITHER  ADEQUATE  RESOURCES 
MUST  BE  FOCUSED  UPON  GAINING  ACCEPTANCE  FOR  THE  INNOVATION,  OR 
A  MORE  TRADITIONAL  APPROACH  MUST  BE  SELECTED. 

•  COURSEWARE  DEVELOPMENT:  IF  THE  COURSEWARE  IS  TO  BE  LOCALLY 
DEVELOPED,  SKILLED  PERSONNEL,  EQUIPMENT,  TIME,  AND  DOLLARS  MUST 
BE  AVAILABLE. 

•  HIGH  COST  ALTERNATIVES:  THE  PROJECTED  LIFE  CYCLE  COST  OF  A 
MEDIUM  APPROACH  MAY  BE  SIGNIFICANTLY  HIGHER  THAN  OTHER  EQUALLY 
USEFUL  ALTERNATIVES. 

•  LEARNING  STYLE  OF  TRAINEES:  IF  TRAINEE  HAS  LOW  READING  ABILITY 
OR  WOULD  BE  LIMITED  IN  HIS  ABILITY  TO  USE  CERTAIN  KINDS  OF  MEDIA, 
THEN  REJECT  THESE  MEDIA  AS  INAPPROPRIATE. 

•  OTHER  CONSTRAINTS:  A  VARIETY  OF  OTHER  PRACTICAL  FACTORS  SHOULD 
BE  CONSIDERED:  e.cj.,  COMMAND  POLICY  AND  EXISTING  INVESTMENT  IN 
PRODUCTION  FACILITIES. 


it*.  * 


selection  algorithm  that  is  useful 
for  s  lecting  TEC  lesson  presentation 
media.  The  algorithm  was  developed 
by  the  U.  S.  Navy,  but  the  specific 
procedures  for  applying  it  to  TEC, 
was  developed  by  Captain  John  T.  Buono 
at  ATSC-TPD  ATECP.  The  complete  pro¬ 
cess  is  given  below. 


MEDIA  SELECTION 


I  ns  truct i ons . 

1.  Once  a  task  has  been  selected  for  training,  it  is  necessary  to  select 

a  medium  for  presentation.  In  making  a  medium  selection,  it  is  important  to 
remember  that  media  does  not  teach,  content  teaches.  The  purpose  of  media 
selection  is  to  attempt  to  find  the  medium  that  is  most  i ns t rue t iona 1 1 y 
effective  and  cost  effective. 

2.  The  charts  and  tables  provide  a  simplified  method  of  determining 
which  medium  to  select,  to  train  a  particular  task.  To  begin,  have  the 
"Media  Selection  Questions"  sheet  and  the  "Media  Selection  Algorithm" 
sheet  side-by-side.  Read  all  of  the  steps  before  beginning. 

o  Step  1  -  Select  a  task  to  be  trained. 

•  Step  2  -  Answer  question  1  on  the  "Media  Selection  Questions" 
she.et . 

•  Step  3  ~  From  the  response  of  question  1,  follow  the 
"Media  Selection  Algorithm"  and  answer  the  appropriate 
questions  in  the  Algorithm,  until  a  media  choice  is  iden¬ 
tified.  A  media  choice  will  be  an  "M"  numbered  block. 

•  Step  h  -  Refer  to  the  "Media  Selection  Choices"  and  the 
"Description  of  Representative  Media  Types"  sheets. 

•  Step  5  -  Once  you  have  identified  the  media  choices  you  must 
select  the  medium  to  be  used.  To  select  this  medium, 
consider  the  following: 

a.  Consider  the  choices  in  descending  order. 


b.  The  lower  the  reading  level,  the  more  pictorial 
representation  is  needed. 


Availability  of  presentation  hardware . 


c . 

d.  Relative  cost  of  the  medium  choice  for  uoth  devel¬ 
opment  and  reproduction. 

3.  Following  these  5  steps  you  will  have  a  simplified  method  of  select 
i ng  which  media  should  be  used  for  instructions.  Remember  that  no 
medium  can  teach;  a  medium  is  only  as  good  as  its  contents. 

1).  The  following  definition  of  terms  should  be  of  assistance  in  using 
the  A1 gor i thm: 

a.  Familiarization  (behavior  level)  -  student  is  expected  to 
gain  a  general  knowledge  of  tasks.  Usually  will  be  associated 
with  introductory  type  lesson^. 

b.  Discriminated  Recall  -  given  a  set  of  previously  learned  or 
presented  tasks,  the  student  will  be  able  to  correctly  choose 
that  task  necessary  to  perform  a  specific  skill. 

c.  Rule-using  -  student  will  use  a  set  of  rules  in  performing 
a  skill. 

d.  Familiarization  (content  level)  -  a  general  knowledge  of 
tasks,  specific  skills  are  not  intended  to  be  taught  at  this 
level.  Familiarization  level  content  is  generally  associated 
with  managerial  knowledge  of  skills. 

e.  Review  -  previously  acquired  tasks  wh  i  eti  need  to  be  refreshed 
as  cither  prerequisite  to  new  skills  or  to  reinforce  the  pre¬ 
viously  learned  tasks. 

f.  Concept  -  a  logical  progression  of  abstract  ideas  that  directly 
relate  to  a  sequence  of  tasks.  Note  concept  level  content  is  very 
difficult  to  develop  in  measurable  terms.  If  concept  level  content 
is  identified,  great  care  should  be  used  in  the  writing  of 

object i ves . 

g.  Rule  -  a  logical  sequence  of  procedures  or  guides  to  the 
accomplishment  of  a  skill. 
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What  is  the  level  of  behavior  expected  o!  the  Is  the  number  of  examples  the  student  needs  to 
student  for  this  task?  see  small  or  large? 

1.  familiarization  1.  Small 

2.  Discriminated  recall  2.  Large 

3.  Ruleusing 

Question  4: 

Question  2.  What  is  the  minimum  display  requirement? 

What  level  of  content  is  being  taught?  ,  Simple  pictoraf 

1  Familiarization  2.  Complex  pictoral 

2  Review  3  Motion  required 

3.  Concept  4.  Interactive  (Student  must  interact  with  an 

4.  Rule  instructor) 

Question  5: 
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Is  the  memorization  component  of  this  objective 
large  or  small? 

1.  Small 


MEDIA  SELECTION  ALGORITHM 


Questio' 

2 

5 

pri 

rn 

m 

M 

UJ 

LLI 

Lii 

4 

U  M 
22 


Question) 


3 Question  1 


puesticn 

4 


[Ml  MS 


Question 

T  5 


Question 

2 


uestio.i  2  [Question 


m 


Question 

< 


Question 


|Qu?st1on 

5 


uostion 

4 


Juestior 


■  iHf. 


V'r  VV 


MFD  I A  SEl  ECTSOH  til)  I  CCS 


HI  •  fentltorketlon,  *  1  •  -p  1  e  Plctcrll 

1  Workbook 

2  Heileted  tnte'ictke 

h2  -  Unillsrketion,  Coulee  Plctorel 

1  Hedllt'd  Interecllve  lecture 

2  SI  Ide/tepe  preo-nt  (ptotjgriph) 

HI  -  Font  lie  Milt  ten.  rollon  required 

1.  VI.I<o  tip* 

2  SI  He/ tip*  x/mtlcn  (r»y  rot  be  wcr th  eepervk) 

HI  -  f anil  krliellcr,  Inierectlve 

It  k  probebly  j  weite  oF  tint  irt J  resource  to  leech  tSk  objective 
et  1  fet'illerk  Jtlon  level 
HS  -  0  kcr  I'*  I  a*  tod  recall,  feMlUrltttlor 

I  nil  i  or  I tit  loo  content  ihculd  rot  be  tiugU  at  o  ncell 

level. 

HS  Dkcrlitmled  recoil,  review,  ikpl  e  .pi  ctorjl ,  deoil  »<»orliotl  cn 

1.  Workbook 

2.  Sllde/tipe  (Artwork) 

3.  Kedijtid  Interactive  lecture 

HI  .  Ckcrlnlntted  recall,  review,  sl-pl »  plctoril,  lirtjr  :-r*v>rkatkv> 

1.  011 

2.  Workbook 

3.  SlliWtipf  (tktrrjrjp'u) 

K3  -  Okcrlnlnated  recall,  rn lew.  co-plea  pktoral 

1.  Slke/tape  (chotegrepM) 

2.  H»>*Utt<<  Interactive  lecture 

M9  -  Ckcrl-lnated  recall,  rrrlrv,  notion  required 

1 .  Y  k«o  lope 

2.  Sllde/tape  with  wfltlon 

J,  Hedlated  Interactive  lecture 
110  -  Olvtrl.nlnated  recoil,  reeled,  Ibterectlve 

Why  Ij  an  Interactive  presertjtkn  reeded  to  leach  dkcrlxtnated  rocoll 
tekavlorl 

HU  -  fikcrtnlnjtevl  reoll,  concept,  »=v*  1  i  r-rorl.’i tlon 

1.  Workbook 

2,  Hedlated  Interact 1 , e  lecture 

tote  You  ray  went  to  ccnblr*  thk  objective  with  tt<  cl  Jool.'lot  Ion 
level  objective  dill  '5  with  th  d  CCrtjnt. 


H12  -  Okcrlnlnated  recall.  enneept,  lirga  r-«orliitlo«,  simple  glclaral 

1.  CA! 

2.  Wo  retook 

3.  SlUe/tape  (Art  work  J 

HU  -  fikcrlnlnj.rd  recall,  COr.crpt,  ltrge  xvnvorl utlon,  csvplea  picture; 

1.  Ill  r/tepr  with  photo/apH 

2.  Hr  ribcok 

HI *  -  rUscrialruted  recall.  corcjpt,  l>rj*  rwwoekatlon,  notion  required 

1 .  Video  tap* 

2.  SHWtap-e  */-«tlon  ltquenced 

3.  I’eJIitd  Iv.erjftln  lecture 

HIS  -  Dldcrl  lira  ted  recall,  concept,  ll-jd  rcvnewtjatlon,  trtereettre 
Why  do  you  reed  an  In'erictlv;  presentation  to  teich  e  dlicrUlnaUd 
recoil  level  khavlcv? 

M16  -  Okcr  ialnated  recall,  rule-using,  ilryle  plctorol,  d»dll  re*orl- 

jetton. 

1.  lordbcok  v/Audln  enly  tepe 

2.  Mediat'd  Interactive  lecture 

hotel  You  ray  not  .ant  to  ctmbk*  thk  ebjeetko  with  the  eoriteiok 
portion  of  t'e  rule-using  level  objective!  dealing  with  tie  content. 

HI7  -  Ckcrlwlnatlon  recjll.  rule-ullrvj.  j  Irple  pktorel ,  Urge  nwwort- 
je tlcn 

1.  CA! 

2.  WrrVbcok  v/ Audio  only  tipe 

3.  SlltV/tspe  (Art) 

HI8  -  DlscrUlrualed  rrcell,  rul  .’-using,  ccaplM  plctorol,  dnall  ne«r1" 
Jit  Ion 

1.  Slkef  tepe  v/photoyapho 

2.  Workbook  w/Audlo  only  tope 

H13  -  ClicrlwIneteJ  recell,  rule-uilrj,  cc-wplpe  pktorel,  Urge  nseecrl- 
ntlcn 

1.  Slldc/tepe  w/photcdr.i,hj 

2.  Werlbco'u  y/\udlo  only  tepe 

M20  •  01  jcrlulnelrd  recoil,  rule-utlry.  erotlcn  required 

1.  VltS-o  tepe 

2.  Slkt/tepe  w/eotion 

3.  Heliikd  l.-.trffictlv?  lecture 

K2 1  -  Clicrr-Ir-I’rl  recoil,  rul»-UiW<j,  Inlerjtllve 

Why  6o  ne»4  ktfrectlve  Ylneletlon  to  tekth  dlocrleelnetM  retell 

tel»e  vlor? 


fvwllUrlntlon  level  control  ihould  not  In  t»w)ht  it  I  ule-ullng 


mil  tmlir  of  txro'vJ 


'we) 

>^d< •  2)  -  Kule-vilng,  review 

1.  Workbook 
2  CM 

KHIl  24  -  Pule-Ult"}.  »*v»ll  Mtorlmlwi,  *l»pl*  plctoril,  l=-»ll  number 
of  evirplei 

1  Workbook 

2.  CM 

J.  Medlited  Interkctlv*  lecture 
4.  Sltde/tipe  (Artwork) 

HeOii  25  -  Rule-UJing  concept,  jnwll  ee-orl Jltlon,  »l«yl*  plcto»ll,  Urge 
fu«Nrr  Of  evinplei 
t,  CAI 

2.  Kendo*  Accen  Sllde/tip*  ^workbook 

3.  SUde/tepe  w/workbock 

4.  Hediited  Intemctlet  lector* 

•  K»dl.i  26  -  Fule-uilrg,  concept,  jmU  remrltetlcwt,  cwplex  plctcwil, 
ovll  robw  of  eiJrplet 

1„  Sllde/tipe  (photos,vip)n)/workb?ok 
2,  kbrkfcook 
.  J.  CAI 

4.  KedUted  Interactive  ltdture 

MtJU  27  -  Rule-uilng.  concept,  will  eiwcr lutlon,  ccmp1e«  pictcnl. 
Urge  cumber  ef  evemple* 

1.  CAI 

2.  **»<*>■  AccfJi  Sllde/tipi/wvkbcok  (pHotoyipM) 

J.  HMleted  Interactlv*  l*ct>w* 

4,  Workbook 

Hedle  n  -  Pule-ulinq.  concept.  Urge  iMwIjitlon.  ilrple  plctcnl, 
inill  rubber  of  *«»«ple» 

1.  Workbook 

2.  CAI 

3.  Hediited  intirectlve  lecture 

4.  Sltde/tape/v'arlbcok  (Art) 

hote:  be  jure  you  h»ve  a  tepente  objective  to  teub  tbe  Urge  r->»or/ 
conponmt  of  thtj  objective  It  tbe  dljirl-ilnited  recall  level 
Pedla  2)  -  Rule-ujlng,  concept,  wall  aenorl  tatcn.  Interactive 
1.  CAI 
?.  Workbook 

3.  Pindcae  Acce'k  Sllde/tipe,  VorkbcoV 

4.  HeJIeted  Interactive  lrctu-e 

Wot*.  Be  jar*  you  hive  a  Irperate  bbjectlve  to  ImcW  tbe  large  ee-eory 
cOfp'nent  of  this  tibj*ctlve  at  the  dtlcrHIretwl  recall  level 


1.  Sllde/tape/workixok  (photcgreplo ) 

2.  CAI 

3.  Mediated  Interactive  lecture 

4.  Workbock 

Mate.  Ce  sure  you  have  *  separata  objective  to  teach  the  large  re*v>ry 
conjoint  of  this  objective  at  th*  discH»l»va  trd  recall  level, 

Pfdti  31  -  Rule-using,  concept,  Itrgr  *****  l?atlo«,  t  vylra  pic  loral, 
Ijrge  run^r  of  cubits 

1.  CAI 

2.  (Urdcr<  Access  SI  ide/tape/vorVtxxA  (photographs) 

3.  Mediate*!  Interactive  lecture 

4.  Workbook 

bote:  Ee  s-ve  you  har*  a  separate  object iv?  to  teach  t**  large 
ccrpor^nt  of  this  objective  at  the  dl scrl finale J  recall  level, 
h^dla  32  -  Rule-using,  rul?  content,  simple  plctoral,  jw*ll  a*«vrl- 
xatlon,  wll  runter  of  eia^ples 

1.  VorVbtok 

2.  CAI 

3.  Hcdlati-d  Interactive  lecture 

4.  SI  ItWtape/wovVbcok  (Art) 

hedia  33  -  Rule-using,  rule  content,  slrpi*  plctoral,  ja^ll  ►ei*cr1r- 
ation,  large  nurtet  of  e*a*»p1es 
1.  CAI 

7.  Ranchi  Access  Si \Ctf tape/ k> r°.nok  (Art) 

3.  Workbook 

4,  MHlsteJ  Interactive  lecture 

Rfdli  34  -  Rule-ostrg,  rule  content,  s1»p1e  plcteral,  large  **nor1z- 
atlon.  snail  nu*bor  of  e«an>lts 
1,  Workbook 
7.  CAI 

3.  HedlatM  interactive  lrcture 

4.  Si  Me/ tape /workbook  (Art) 

>«te:  Te  sure  you  Ka*-  a  separate  chjectlve  to  teach  the  large  9**q ry 
corp:<^ent  of  this  ohj^tive  at  tH-*  Jlscrl ulna  Ud  recall  lsvrl, 

Hodla  3S  -  Rule-using,  rule  content,  simple  plctoral,  large  Pf**ar|- 
tatlua,  large  rioter  of  e^a-v^** 

1.  CAI 

)  2.  Ran<j(.«  Access  MlCe/tape/»*crkScoV  (Art) 

|  3.  WorTuook 

4,  Mediated  Interactive  lecture 

Mote  te  sur#  you  have  a  separate  ct>J?:tive  to  tea;h  the  larg«  ***ory 
1  coro  neot  of  this  objective  at  t*?  dlscrl^lrated  recall  1ml. 


JS  -  Kul«-utl"9.  rule  content,  coeplet  plctore),  jvull  rr«r:- 

hedle  41  -  Pule  uvlmj.  concept,  lerje  umorljettovv,  jleple  plcturel. 

letlon,  i»e11  ru*h*r  of  eu'plei 

inel  1  ru»b*n  of  en»ple» 

1.  Sllde/tepe/orktock  (photosrephs) 

1 .  kortboc* 

2.  CAI 

2.  CAI 

3.  Pedle'.evl  Intereetlve  lecture 

3.  Acileted  Intereetlve  lectu-e  , 

4.  i.  uo*  eccekv  vl  .  d«/c,,v  ulth  uortbook 

4.  Uifkbotk 

McJle  37  -  Pule-uilnt.  rule  content,  coaplei  pleterel,  juell  rcwrl- 

Ante:  te  lure  you  heve  e  tepirele  chjec'lve  to  toec-S  the  lxpe  Mr*>ry 

retlon.  terje  mj»t«r  of  euvplei 

coup' rent  of  tblj  objective  et  the  dticrlalneted  recell  level.  , 

We-fle  4?  -  Pule  uil»9.  concept,  lirje  r*»ccl cello* ,  lerje  ix»b*r  of 

1.  CAI 

2.  Rendc*  AccetJ  Slldr/tepe/workbcok  (photojripht) 

expaples 

1.  U] 

J.  PiJlitt.)  Intereetlve  lecture 

4.  Workbook 

2.  Rind-*  ecceJJ  tllde/lepe  w/verkb cok 

hedli  3)  -  Rule  iinrj,  rule  content,  couplet  picuorel,  lirje  »»«orl- 

3,  MefleteJ  Interactive  lecture 

ntlen,  j*»ll  n»ter  of 

4.  lorkieok  ulth  Audio  cnly  tipe 

1.  AenJta  ecceu  Jltdf/tepei’.  irktock  (photo^reph) 

Mote  t»  lire  you  K*v»  e  seperete  objective  to  texb  the  lirje  w*ory 

2.  CAI 

component  of  thll  objective  et  the  dl itrlalneted  retell  level. 

3.  Pcdleted  fnterectlv#  lectirr 

»ile  43  -  Pule  oilnj,  corcept,  lirje  ?r«cr  Itetlovv,  notlov  retired 

4.  Workbook 

1.  Video  tipe 

Hole:  Jure  you  hire  <  sepente  objective  to  leech  the  lerje  »/e»ory 

2.  t'-'leted  Interactive  Ifcture  l«1tS  VT) 

ccrpooenl  of  thli  objective  it  tne  dlscrlolmteJ  retell  level. 

3.  SlO/t.ipe  with  rot  Ion  • 

Hcdle  33  -  Rule  ttlng.  rule  center:,  couplei  plctorel,  luje  rjor  1- 

note:  Pi  Sure  you  hive  e  leperete  cbjectlve  to  touch  the  lerje  mwi? 

jetlr",  ler$4  nrttr  of  eiu-plej 

cevpment  of  i'll  *  objective  et  the  dlicrlnlrited  recall  letjl, 

1.  CAI 

Hedl,  44  .  Sole  uilrr),  concept,  1»r^«  eeaorl  title*.  Intemtlrj 

3,  Kedlited  Interietlve  lecture 

1.  StruleUr 

3.  Aendw  icctit  Jllde/t.^e/rorkbcok  (phc’tojrjpk) 

2.  Actuel  ejulp-cnt  with  workborA  end  eudlo  cnly  tip*  ‘ 

4,  Wrokbcok 

3.  CAI  ttnul.tlon 

Hole:  te  jure  you  heee  e  leperete  objective  to  te*cb  th*  lirje  oevnry 

4.  Video  tipe 

carpcvtent  of  tblj  objective  it  th*  dbcrlrlneUd  retell  level. 

Wedle  4J  .  Rule  uilrj,  ecncept,  tmll  -eeorlmt  on,  ivicton  required 

Medle  40  -  Rule  ulirp,  rule  cont'*'t,  notion  retired  Cr  l.vterjctlve 

1.  Vldeotep* 

).  A  Jltwletor  or  the  ectuel  evpilpatnt,  workibeet  end  en  Aulle 

2.  SI  ldr/t>;*  ulth  notion 

Only  tepe 

3.  Kedletnd  Interectlve  lecture  (ulth  VT) 

2  CAI  jl»vl et ion 

I 

3.  Vidro  tip*  lluuletlew 

1 

i  1 

The  description  of  sore  specific  neS'.a  categories  are  preientad 


Thl»  tilt  i»  f»r  f rc*  eshaustlve,  and  the  ►  edii  harder*  devices 
which  can  be  used  to  present  these  types  of  Inunction  vary  widely, 
towever,  this  tilt  doei  dresent  <  representative  Sa«ple  of  the  range 
of  ttdla  available. 

1 )  He-lllted  Interactive  lecture  (HU.) 

As  with  eqy  lecture,  the  major  portion  of  the  Instructional  material 
ll  *  Hit.  presented  verbally  by  an  Inatrutto.'  to  a  group  of  studmti.  How¬ 
ever,  as  the  n*e  states,  a  MIL  rust  be  both  mediated  and  Interactive. 

A  Hit  requires  t-o  herd  copy  preducts,  student  worksheets,  ard  vltual 
aids,  tbe  student  worksheet  Includes  a  set  cf  tesson  objectives,  the 
generalities  for  each  objective,  necesstry  charts,  tables,  a'd  flgires, 
end  e  set  of  practice  tten  restonse  sheets  for  each  cbjettlve.  The  type 
of  vlsul  aids  used  In  a  “II  may  Include  overhead  transparencies ,  slides, 
or  vldrotiiws,  depending  on  IN:  display  requirements  of  t'e  lesson,  these 
aids  are  used  where  appropriate  to  present  Supporting  Information,  sets  of 
tramples,  and  sets  of  practice  Items, 

In  erder  for  a  lecture  to  be  adaptive  to  student  reeds.  It  rust  be 
Interactive.  An  Interactive  lectsre  provides  the  Instructor  with  an 
outline  which  requires  hi'  to  esl  the  students  questions  and  alter  Ms 
presentation  based  on  student  responses. 

I)  Printed  Te«t 

The  defining  characteristics  of  a  Printed  Teat  Is  that  all  Instructional 
components  are  presented  In  printed  form.  Pvlntrd  Teat  ray  te  developed  for 
*  set  cf  ohjtctlves  that  require  the  Student  to  perform  at  a  remember  (recell, 

or  recognise)  behavior  level  only,  or  for  objectives  that  require  the  student 
to  perforin  at  *  classification  or  rvla-ullng  behavior  level. 

The  onanl-’at'on  e"4  format  of  workbook  ensures  that  all  Inst rvcttor.il 
components  *r»  present.  The  uorkbtck  begins  with  i  lesson  Introduction 
and  a  set  Of  Instructions  explaining  hoe  to  proceed,  rich  segment  (corres* 
pondteg  to  One  objective)  begins  by  pmenllrg  th*  cbjictln,  th»  generality 
knl  the  importing  eiplsnitlcn  or  help.  Where  eecessary,  the  eamolts  a  re 
accompanied  by  additional  "helps".  The  prjctlca  Items  an  designed  to 
require  the  student  to  behsv;  at  the  levs)  designated  l»  tha  cbjec’.tve. 

The  prattler  Set  Is  eoctmpinlH  by  a  fee'lbacV  ,ind  halp  section. 

3)  51lde-Tacv»  Presentation  (M) 

A  slide-tape  prrsrntjtlcfl  contains  two  separate  c  tpvpcnents:  a  sat 
of  slides,  or  plutograpMc  frames,  audio  sections,  (a  student  worksheet  nay 
be  Included).  The  ST  presentation  Is  romally  used  for  recall  level  object¬ 
ive  that  require  ccnplea  graphics  sri/or  length  ea?l  mat  Ions, 


f’v*i  PtS^B«asi:t*nn«t 


,..„»-s»ojn*»»«v*-.ncn<ae»r  w> w»mrv  -w—  never 


I  be  audlokpe  begins  with  an  Introduction*  Tor  each  objective,  It 
restit^t  th*  generality  lid  presorts  asMItlpul  spportkg  Inf  .**a  tfc*. 

The  slides,  of  course,  corpl  event  t><*  audiotape.  Vive*  working  with  clari¬ 
fication  er>d  rula-uslnj  leval  cfcjectlsas,  a  wrlys  of  et.*xp1«  Is  presented 
with  accmp*any1g  “Kelps*  wfere  needed.  A  set  of  frectke  lUv*  |>  present  »1 
ivut.  The  student  Is  told  to  stop  the  Up*  after  e*ch  v«**t1**  ) *»1  writs  hit 
on  Ms  worksheet.  When  If*  Up*  Is  storied  a;iii,  I;  gives  fiJdMtk 
and  help  frr  tS*t  Itan, 

4 )  Pindo^ccji^  Slid*  Pr?vabatkn  (PAS) 

A  rjnJo**iccrt»  slid*  pr  ftMlatl  c*  centals*  Ui  components:  a  set  cf 

tilde*  presented  via  a  rj>Jc*- access  slide  projector  or  ftssltr  C^»/S«*« 

student  wck /book,  an  an  audio  only  tap*.  An  M5  pntentit  In*  It  used  t> 

present  1  assc*  *vter1  il  for  cl  ml  Motion  ord  rjle-sitl  *>9  1  av*l  cf>J*:t1vt. 
This  allots  for  visual  presentation  of  larr*  r<^J>*rs  of  eiarples 

and  practice  Item  without  sacrificing  the  frteJc*  of  fy;v£r**nt  (l.e., 
learner  control)  lost  im  the  llrrar  ST  or  videotape  (VT)  present  a  1 1  on . 

The  workbook  presents  tables  of  runltrei  example  1l*v»s  i.H  practice 
Hem.  toe  student  can  use  these  IsMes  to  clvwk  those  e*w*p)?t  M  h»s 
viewed,  or  the  practice  item  he  has  worked.  the  practice  tible  also 
provides  space  for  the  student*!  response. 

•  The  ranJtrvjccrss  slides  are  g»>!  to  present  era  eip.srded  venkn  of 
the  generality,  the  ii*t  of  eorples  with  help,  practice  ItM,  ird 
feedback. 

5)  V1drotap>  1rrs«»ntaMjrn  (VI) 

A  vtdwtspe  pres  entitle*  contains  t*o  Cfi*»6mnts:  a  vlirotife 
cassette  and  a  student  vorksheat.  The  use  cf  these  tv*  components  Is 
exactly  parallel  to  tne  use  of  corrcsrordlny  ccwpor^nts  of  th*  slide-tap* 
presentation.  He  rajor  difference  between  these  t*p  media  Is  the  type 
of  display  capability  The  Instmtknal  strategy  us*d  Is  similar  In  both 
type*  of  redla  . 

because  the  devrl.vment  cost  fcr  VTs  can  ury  widely  depending  on 
the  type  of  effect  needed,  citogcrki  of  VT  complexity  reed  to  t*  speci¬ 
fied.  Mve  rapesentatlv*  categories  have  teen  designated  VT  (11),  VT  (#2), 
VT  lUh  VT  (fA),  vrr  (»*).  Each  of  these  categories  will  U  dascrlted 
brlow: 

An  arl^ated  vlJenU;*  (V?  (a))  presents  abstract  concepts  and  Ideas 
through  the  use  of  cartooning.  This  type  of  v1d>ota;«  Is  ts-*i  vhen  rotl- 
vstlun  Is  a  critical  reg.»1rr*eM. 

A  le>el  three  vldi-otap*  |fT  (#5))  Is  the  result  cf  pro'essioral  treat- 

►ei*.  fcr  loth  the  direction  tnj  projection  aspects  cf  the  process,  Produc- 

tlcn  techniques  and  features  Available  for  Instructional  ut  dilation  arc 
super  1<n,jo si  t!;*  (labeling),  s  lev  rot  Ion,  ard  special  e'fecls  generation 

(attrlovte  Isolation),  multiple  fades,  dissolves,  wipes,  special  efftcU, 

asislc,  anj  audio  "king.  This  1  we  1  vld^ot-ipi  1rcliK>s  full  dra.ta tka t Ico 

with  <{ual  Ity  acting.  In  total  or  In  pirt  frrvs  tljt.tly  written  ard  Strry- 

loarded  scripts,  essentially,  this  Is  tha  lil;h  cc^t^VMph  effect 

Cadillac  cf  videota'if  p»-o Njc  don. 


A  level  two  videotape  (VT  (;:))  rec«lve»  a  Ilka  p-eiictlx  effort 
<1  that  recslved  by  >  level  3.  bat  dr  „»itlllt  Ian  li  cnttted.  V » f c e -<.» •  »*■ 
or  on-lcrt*n  nsrrstlcn  dell  vers  ccntant.  I »j 01  rf  labels.  lists,  »tc., 

Are  ror«  prevalent.  Hetlvlutlon  Is  cjrrl*d  tersely  thrpujh  ciMn  hovoaent 
snd  sost-productlon  special  effects  oefleratlon. 

A  level  en«  videotape  (VT  (/!))  ts  a  ore-ca were  effort,  •  ther  live 
action,  voice-over,  pr  >  •  1  < ture  of  this  *tvJ  thi  *bl>  talklnj  fate"  approach. 
Motivation  It  alnlnal  In  cc*«parlicn  to  >  Level  3  or  l  (I.*.,  special  effects 
fi  neretloi  sod  "slick"  videotape  techniques)  available  In  >.i  extensive 
po  t-productlon  effcrt  And  reduced  to  nore  straightforward  es'l*.lr{, 

A  "hone  rove"  level  videotape  (VT  (IX))  normally  utilises  edt t-tn-the- 
contra  technicians  with  lljh:w*|r>it,  often  hand-hald  portable  cqutpwent. 

This  level  Is  often  black  sod  white  with  A  nl.nlm^i  quality  1  •  j\t I 'j  effect. 

All  nirretlcn  Is  *5lce-tvtr  and  a  ay  t-e  recorded  aloe-9  Kith  t'e  video, 

6)  ttnnutee.Asjlsted  Irstrid  Ices  (CAl) 

II*  daflol.ij  charscterlstlcs  of  cc-pvter-assl  sled  Instrictlon  Is 
thst  It  presents  t.itarspttve  e>;fsltc*-y  ard  Irqultltufy  tosL-tcLIcn  through 
direct  Interface  with  *  con;-, ter.  It  Ia  distinguished  froe  s  trainer  In 
that  It  It  nut  detlqntd  for  tlwulttlen  puposas. 

toesuse  ccrputar;  a  re  proyowvable,  It  Is  possible  f.v  s-y  hardware 
systwi  to  prattn*.  Instruction  rant  a  I  nl  nj  sll  bast:  Instructional  re,-,j|rcv*fts. 
hbwevnr,  prpferrnce  should  t<  {Iren  la  any  syttM  >J>lch  ecoroudcally  art! 
efficiently  fulfills  ill  of  tie  Lisle  Instructional  r cq jlr.monts  outllaes 
above 


7)  HnJs-on  f»er;l'»t 

A  hands-on  eierdse  ll  used  to  allow  tSf  student  to  practice  dassl- 
flcst'on  rul«-u$ln{  procedure-using  t-ekavtors  In  a  simulated  resl  anvld 
envlroment.  :Tf»  type  of  hardware  used  depends  cn  the  dr-ye* 

of  fidelity  to  the  real  world  required.  hards-en  exerclsea  will  rorwally 
be  used  with  PAS,  SI,  er  aurkhocks. 

In  addition  to  the  obvious  req-alrmtnt  for  a  hifds-on  ea-arclse  to 
Include  the  use  of  any  roal  er  stvalatod  equipment  u-ad  In  the  Actual 
Job  ervlroraient.  It  also  Inc lul os  an  Audio  only  tope. 

The  Audio  tape  presents  tka  student  with  the  set  of  lessen  cbjvct- 
Ives.  a  lesson  Introduction,  sod  s  sut  of  I nstructl cel  describing  what 
he  should  do  to  to  prepared  for  the  exercise,  the  Audio  tape  thin  presents 
any  Inforrratlcn  the  student  will  reed  for  wiulrwa  planning  purposes,  and 
It  spells  cut  exactly  what  planning  1*  vrt  11  nec-i  to  hart  prey-ared.  live 
Audio  tape  then  outllnai  In  detail  the  prcc.viurri  or  setters  t1*  student 
should  perforn.  Previously  restored  prorcdvrjs  are  referred  to  by  fvie  wlth.n-.it 
the  accc-vpsnylnj  list  of  steps. 


Guilford,  N.  L.  Current,  research  on  Uie  relative  effectiveness  of 
selected  media  characteristics.  Pittsburg,  Pennsylvania: 
Westinghouse  Electric  Corporation,  Research  &  Development 
Center,  October  1973-  (This  reference  presents  research 
findings  on  the  effect  of  using  various  media  characteris¬ 
tics,  viz.,  picture  detail,  color,  motion,  and  integrated 
media  .1 


I'RADOC  PAMPHLET  350-30.  ISP:  Phase.  111.  Fort  Monroe,  Virginia: 
U.  S.  Army  Training  and  Doctrine  Command,  August  1975- 
(Pp.  106-12*4  present  a  rationale  for  media  selection  and 
presents  a  detailed  decision  process  for  deciding  upon 
the  best  medium  from  among  all  available  media.) 

U.  S.  Navy.  Specifications  for  instructional  systens  development 


for  operator  job  training  related  to  emerging  weapon  systems 


Orlando,  Florida:  Human  Resources  Laboratory,  (no  date 
available).  (This  document  presents  the  development  of  a 
media  selection  algorithm.) 


*4.1.2  TEC  Lesson  length 

The  next  most  significant  de¬ 
cision  to  be  made,  is  the  length  of 
the  lesson,  or,  how  many  kits  are 
required  to  package  the  total  1 E C 
lesson.  Although  overall  lesson 
length  is  of  relatively  little 
importance  for  PT  lessons,  each 
PT  lesson  should  consist  of  easily 
comprehensible  parts,  £.£.  ,  kits 
which  require  approximately  50 
minutes  to  read  and  to  work  the 
practice  exercises.  JPAs  are  by 
nature  shorter  than  the  other  TEC 
lessons.  For  AV  and  AO  lessons, 
length  and  number  of  kits  are 
problems.  Many  factors  have  to 
be  considered  since  actual  lesson 
length  requires  a  trade-off  among 
multiple  i nputs. 


_  ,  i ng  rea  i  - 

istic  and  measurable:  standards  for 
each  soldier's  training  and  career  pro¬ 
gression  is  a  guiding  philosophy  of 
the  U.  S.  Army.  As  discussed  in 
Chapter  1,  it  is  the  Enlisted  Per¬ 
sonnel  Management  System  (EPMS)  that 
establishes  the  relationship  among 
grade  structure,  required  skills,  and 
levels  of  training  for  each  Military 
Occupational  Speciality  (MOS) .  As 
integral  parts  of  EPMS,  TEC  lessons 
are  related  to  Soldier's  Manuals  tasks 
and  the  SQTs.  These  form  the  nucleus 
for  the  development  of  a  Job  Training 
Package  based  on  a  task  analysis  of 
a  soldier's  entire  job  (part  of  an 
MOS,  or  sometimes  a  complete  MOS)  . 


In  the  past,  the  development  of 
TEC  lessons  focused  on  individual 
tasks,  ,  the  assembly  and  dis¬ 

assembly  of  the  M60  machine  gun.  The 
lesson  content  was  based  on  a  systema¬ 
tic  analysis  of  individual  tasks  but 
not  of  the  tasks  for  a  complete  MOS. 
Future  efforts  must  have  a  wider  scope. 
The  systems  analysis  approach  to  Job 
Tiaining  Package  (JTP)  development 
will  provide  you  with  a  complete  list¬ 
ing  of  training  objectives  for  a  job. 
Completion  of  the  analysis  requires 
grouping  the  objectives  into  sets  or 
subsets  which  can  be  packaged  into 
job  based  lessons.  Knowing  the  tine 
it  takes  to  convey  each  objective 
provides  some  idea  of  the  length  of 
an  individual  lesson.  Lengthy  lessons 
may  require  subdivision  into  more 
manageable  units,  i.e.,  multiple  kits. 


ISP  tloclet  and  Legion  Grouping.  Ac¬ 
cording  to  the  151)  model,  the  Analysis 
and  Design  sections  of  each  school  are 
responsible  for  defining  and  describing 
jobs  as  well  as  the  duties  associated 
with  each  job.  These  duties  are 
then  broken  down  into  task  statements. 
Finally,  the  tasks  are  described  in 
terms  of  t lie i  r  basic  behavioral  elements 
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referenced  test  items  that  are  required 
to  teach  the  task  elements  of  each  TEC 
lesson.  If  this  is  not  done  elsewhere 
you  wi I  I  have  to  perform  the  above 
function.  An  example  of  a  task  de¬ 
scription  for  a  duty  position  that  can 
be  used  to  determine  what  behavioral 
elements  to  'each  in  a  TEC  lesson  is 
given  below. 


i.* 
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Job: 

MOS  72  C  -  Central  Office  Switchboard  Operator 

Duties: 

1. 

Installation  and  operation  of  Switchboard  Telephone,  Manual  SB-22/PT 

2. 

Installation  and  operation  of  Manual  Telephone  Switchboard  SB-86/P 

3. 

Installation  of  Central  Office  Telephone,  Manual  AN/MTC-1 

4. 

Operation  of  Central  Office  Telephone,  Manual  AN/TTC-23,  AN/MTC-1, 
Afl/MTC-9 

5. 

Operation  and  maintenance  of  generators 

Tasks 

:  (Duty  #1) 

1. 

Field  telephone  operation  TA-312/PT 

2. 

Preinstallation  checks  of  switchboard  telephone,  Manual  SB-22/PT 

3. 

Line  and  trunk  connections  of  switchboard  telephone.  Manual  SB-22/PT 

4. 

Line-to-line  and  recalls  with  switchboard  telephone.  Manual  SB-22/PT 

5. 

Line-to-cal 1 ing-party  and  emergency  checks  with  switchboard  tele¬ 
phone,  Manual  SB-22/PT 

I 

6. 

Conference  calls  and  trunk  calls  with  switchboard  telephone, 

Manual  SB-22/PT 

Flements:  (Duty  if] ,  Task  H2) 

1. 

Install  batteries 

* 

2. 

Preinstallation  checks 

a)  check  #1 

b)  check  ¥ 2 

* 

* 

li 
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the  task  analysis,  the 
training  objectives,  and 
the  criterion-referenced 
test  items  with  subject 
matter  experts  (SME) .  The 
purpose  of  this  review  is 
to  insure  the  validity  of 
objectives,  the  compatabi 1 i ty 
with  present  training,  and 
the  relationship  to  current 
soldiers'  manuals. 


The  TEC  developer 
(ei ther  the  school  or  a 
contractor)  is  responsible 
for  grouping  task  elements 
into  individual  TEC  lessons. 
A  TEC  lesson,  however,  can 
be  composed  of  one  or  more 
TEC  kits.  A  TEC  ki t  is 
the  packaged  material,  e.£. , 
the  audio  tape  in  an  AO  kit, 
used  to  present  a  lesson  or 
a  logical  subdivision  of  ’  . 
The  difficult  part  is  de¬ 
ciding  how  many  TEC  kits 
are  needed  to  convey  the 
terminal  training  objectives 
of  each  TEC  lesson.  One 
task,  however,  does  not 
have  to  be  covered  in  a 
single  TEC  kit;  it  can 
span  two  or  more  kits. 
Similarly,  if  tasks  are  re¬ 
latively  s’mple,  one  kit 
could  cover  two  or  more  task 
One  way  to  decide  on  the 
number  of  kits  necessary 
for  one  lesson  is  to  sketch 
out  the  complete  lesson  firs 
Then,  an  estimate  of  time 
for  presenting  the  complete 
lesson  can  be  made.  If  the 
lesson  is  too  long,  you  can 
divide  it  into  several  kits 
at  logical  breaks  within 
the  lesson. 
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to  describe  it  is  the  next  factor  that 
relates  to  overall  lesson  length,  i_.o,  , 
how  shoul d  the  training  objectives  be 
stated  to  insure  an  effective  TEC 
lesson.  Therefore,  the  TEC  developer 
should  follow  a  set  of  systematic 
guidelines,  e.£.  ,  tho^e  discussed 
in  the  ISO  model  (Block  I  1.1  pp.  1*3*0 
or  TRA00C  Pamphlet  350*31  (pp.  18-23). 
Applying  these  guidelines  (stated 
below)  to  each  lesson  will  aid  the 
structuring  and  formatting  of  each 
TEC  kit. 


*>  EXPLICITLY  STATE  EACH  OF  THE  TRAINING  OBJECTIVES  FOR  EACH  T EC  LESSON 
ACCORDING  TO: 

1.  ACTION  TYPE 

-  SPECIFIC 

-  GENERALIZED  SKILL 

-  GENERALIZED  BEHAVIOR  OR  ATTITUDE 

2.  DESCRIPTION 

-  FULL 

-  PARTIAL 

-  STATED  ONLY 

3.  RELEVANCY 

-  HIGH 

-  MODERATE 

-  LOW 

4.  COMPLETENESS 

-  ACTION,  STANDARDS,  AND  CONDITIONS 

-  ACTION  AND  CONDITIONS  OR  STANDARDS 

-  ACTION  ONLY 

5.  PRECISION 

-  FULL 

-  PARTIAL 

-  VAGUE 

o  TO  THE  FXTENT  POSSIBLE,  INCLUDE  ACTIVE  PRACTICE  AS  PART  01  THE  LESSON, 
o  ADD  GUIDANCE  AND  PROMPTS  TO  LEAD  THE  STUDENT  THROUGH  THE  LESSON, 
o  PROVIDE  FEE03ACK  TO  STUDENT. 

«  DESCRIBE  CRITERION-REFERENCED  TEST  ITEMS  IN  TERMS  OF  THE  OBJECTIVES. 
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-  The  following  is  a  training  objective  that  states  a  specific  action; 
contains  a  full  descript:on;  is  highly  relevant;  is  cnnDlete  with 
stated  action,  standards,  and  conditions;  and  is  fully  precise. 


SCHEDULE  PREVENTIVE  MAINTENANCE  ON  RADIO  SET  AN/VRC-12  FOR  MONTH 
OF  JULY  1978  WHEN  GIVEN  DD  FORM  314,  TM  38-750,  TM  11-5820-401-20, 
AND  DATE  OF  LAST  SERVICE.  THE  COMPLETED  SCHEDULE  SHOULD  CONTAIN 
MO  MORE  THAN  TWO  ERRORS  WHEN  PREPARED  IN  15  MINUTES. 

-  The  following  training  objective  states  a  specific  action,  but,  it 
contains  no  description,  has  questionable  relevancy,  is  incomplete, 
and  is  vague. 

FIELD  STRIP  A  RIFLE. 


LENGTH 

OF 

TEC  KIT 


_  STIMULUS 
TIME 


RESPONSE! 
TIME 


e  STIMULUS  TIME  SHOULD  NOT 
EXCEED  20-30  MINUTES 


St  a  mu  tui/ReApoiiAe.  T-imc .  The 
total  length  of  a  TEC  kit  is  the 
combination  of  stimulus  time  and 
response  time.  These  times  and 
the  ratio  of  the  two  are  all  im¬ 
portant  in  determining  lesson 
length. 

ISD  states  that  most  in¬ 
dividuals  cannot  remain  completely 
attentive  during  a  20-30  minute 
period.  Thus,  a  TEC  lesson  should 
not  contain  a  continuous  running 
narrative.  The  total  stimulus 
time  should  not  exceed  20-30  minutes. 
You  should  break  this  time  at 
logical  intervals  to  actively  in¬ 
volve  the  student  in  the  lesson. 

The  active  participation  is  the 
response  time  component  of  the  lesson. 

There  are  two  ways  to  include 
active  participation  in  the  lesson: 
having  the  student  answer  questions 
during  and  after  the  lesson,  and 
using  practical  exercise.  The  ex¬ 
ercises  acquaint  the  student  with 
the  equipment  while  the  lesson  explains 
how  to  use  it.  For  example, 
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dents  watch  is  not  as  ettective 
as  allowing  each  student  to  dis¬ 
assemble  the  weapon  while  pro¬ 
viding  individualized  instruction. 
Active  participation  always  includes 
student  feedback.  Providing  correct 
answers  and  reassuring  comments 
lets  the  student  know  what  is 
wrong,  what  is  right,  and  how  his 
performance  can  be  improved. 

The  ratio  of  narrative  to 
response  time  is  a  function  of  how 
many  review  questions  and  practical 
exercises  are  used  in  the  lesson. 
Frequently,  the  response  time  will 
exceed  the  stimulus  time. 


NumboA.  o{)  ViAuati .  If  you 
are  supervising  or  monitoring 
the  development  of  a  TEC  kit, 
it  is  important  to  have  an  idea 
of  how  many  visuals  you  will 
need  because  lesson  length  is 
also  a  function  of  number  visuals. 
For  example,  if  you  are  designing 
a  lesson  for  the  disassembly  of 
an  Ml&AI  rifle,  do  not  plan  a 
scries  of  visuals  of  isolated 
weapon  parts  when  a  single  ex¬ 
ploded  view  would  be  more  effec¬ 
tive.  Specifying  the  number  of 
visuals  to  support  the  associated 
narrative  for  a  particular  TEC 
kit  will  help  structure  its 
overall  length.  The  number  of 
visuals  per  kit  should  be  con¬ 
sistent  with  TEC  Request  for 
Proposals  (RFPs)/contracts. 

T n fluting  Cbj'e ct-iv ca  and 
C-ut c v  uni-Re ftcncncccl  Te-s t  1  fpi» . 

The  final  factors  to  be  considered 
for  lesson  length  determination 
are  the  numbers  of  training 


ACTIVE  PARTICIPATION 
®  REVIEW  QUESTIONS 
•  PRACTICAL  EXERCISES 


RULLS-OF-THUMB  FOR  TRANSLATING 
SINGLE  FRAMES/ VISUALS  (NO 
ANIMATION)  INTO  LESSON  TIME: 

1.  AVERAGE  NUMBER  OF  VISUALS 
PER  KIT  =  120 

2.  150  FRAMES  =  APPROXIMATELY 
35  MINUTES 
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TEC  LESSON  ON  THE 


VEHICLE 


OBJECTIVES:  1.  REPLACE  THE"Y" 


2.  REMOVE  THE 


3.  TURN  TUP: 


CHECK  THE  "Z* 


KIT  "A" 
OBJECTIVE 


KIT  "B" 
JBJECTIVE 

/r‘l 


KIT  "C"  » 
OBJECTIVE  j 

n 


include  a  single  TEC  kit.  The 
training  objectives  state  what 
a  student  should  learn  in  a  TEC 
lesson.  The  criterion-referenced 
test  items  measure  how  well  the 
student  has  learned  the  training 
objective.  The  number  of  training 
objectives  per  lesson  depends  on 

- the  amount  of  time  needed  to  teach 

the  tasks  that  are  required  to 
achieve  the  terminal  training  ob¬ 
jective.  The  number  of  criterion- 
referenced  test  items  for  the 
lesson  depends  on  the  number  of 
tasks.  How  to  divide  the  training 
objectives  and  test  items  among 
the  kits  must  still  be  determined. 
Consider  the  training  objective  - 
to  be  able  to  install  new  batteries 
in  a  radio.  To  achieve  this  ob¬ 
jective,  a  student  may  have  to 
know  specific  information,  £.£.  , 
knowing  which  batteries  to  instal’ 
positioning  the  batteries,  locking 
the  battery  compartment,  etc. 

— r  Therefore,  the  number  of  criterion- 

r7T\  referenced  test  items  should  be 
yp  j  the  number  needed  to  measure  the 
I  learning  of  the  objective,  £.£.  , 
i  what  type  of  batteries  do  you 
1  install,  how  do  you  place  the 
_  jJ  j  batteries  in  the  radio,  how  is 

the  battery  compartment  closed  and 
locked,  etc?  Depending  on  the 
length  of  the  total  lesson,  this 
may  require  only  one  kit  or  more 
than  one. 

A  final  consideration  is  the 
importance  of  each  training  ob¬ 
jective.'  Some  objectives  may  be 
more  critical  than  others  (£•£•, 
those  that  concern  surviving  in 
combat).  Therefore,  more  lesson 
time  (if  more  time  is  needed  to 
teach  the  objective  in  greater 
detail)  may  have  to  be  devoted  to 
these  more  critical  objectives. 

(See  Chapter  5  for  rating  the  im¬ 
portance  of  training  objectives.) 


TRADOC  PAMPHLET  3 5>0 - 3 0 .  ISP:  Phase  I.  Fort  Monroe,  Virginia:  U.  S. 

Army  Training  and  Doctrine  Command,  August  1975-  (Job  analysis 
is  discussed  in  Blocks  1.1  and  1.2,  f>p.  I  - 1  S>5  - ) 

TRADOC  PAMPHLET  350-30.  ISP:  Phase  I  I .  fort  Monroe,  Virginia:  U.  S. 
Army  Training  and  Doctrine  Command,  August  1975-  (Developing 
training  objectives  is  discussed  in  Block  I  I.  I,  pp.  1  -  3;* . ) 

TRADOC  PAMPHLFT  350-31.  (Draft).  Preparing  extension  training.  Fort 

Monroe,  Virginia:  U.  S.  Army  Training  and  Doctrine  Command,  February 
1976.  (Pp.  18-23  discuss  the  development  and  statement  of  training 
object i ves . ) 

Consult  Recent  TEC  Request  for  Proposals  (RFPs)  for  any  specific  guidance 
provided  for  stimulus/response  times  and  number  of  visuals. 


h. I . 3  Target  Audience  Consider a t ions 


TEC  lessons  ore  developed  to  train 
the  audience.  Soldiers  must  be  able  to 
perform  the  critical  tasks  of  their 
primary  MOS.  And,  the  TEC  system 
will  facilitate  the  training  of  these 
tasks.  This  facilitation  will  occur, 
however,  only  if  the  target  audience 
unders tanas  the  TEC  lesson.  There¬ 
fore,  you  have  to  be  aware  of  the  skill 
levels  the  audience  brings  to  the 
training  environment.  In  addition, 
you  have  to  (1)  pitch  the  instruc¬ 
tional  materials  to  the  ability 
level  of  the  audience;  and  (?)  use 
the  appropriate  nomenclature  of  the 
spec i f i cd  task. 


TARGET  AUDIENCE 

0  USE  APPROPRIATE  READING 
AND  COMPREHENSION  LEVELS 

•  USE  APPROPRIATE 
NOMENCLATURE 


Reading  Level .  In  the  past, 
most  instructional  materials  were 
printed.  Thus,  compi  ehens ion  was 
closely  related  to  reading  ability. 
Presently  in  TEC,  however,  approxi¬ 
mately  80%  of  all  TEC  kits  are  de¬ 
veloped  in  media  other  than  printed. 
Therefore,  instead  of  reading  ability, 
the  verbal  comprehension  of  the 
target  audience  should  establish  the 
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Keaa i ng  ability  or in¬ 
dividuals  can  be  determined  by 
a  quantitative  measure,  the 
readability  score.  In  general, 
a  lovi  readability  score  predicts 
a  low  comprehension  level.  An 
extension  of  readibility  formulas 
is  the  estimation  of  school 
grade  levels.  Grade  level  re¬ 
fers  to  those  students  who  reach 
a  specified  criterion  level  on 
a  comprehension  test.  For  ex¬ 
ample,  a  readability  score  of  8 
means  the  individual  is  reading 
at  the  same  level  as  an  average 
leader  in  the  8th  grade  (at  the 
time  the  reading  level  standards 
were  established). 


Thus,  if  you  can  determine  the 
reading  ability  or  verbal  compre¬ 
hension  of  the  target  audience  from 
available  data,  _c.g_.  ,  service 
entrance  examinations,  do  it. 
Otherwise,  you  will  be  forced  to 
make  subjective  judgments  regarding 
the  target  audience's  comprehension. 
If  you  guess  too  low,  you  will  be 
talking  down  to  the  audience  which 
they  will  resent.  On  the  other 
hand,  if  you  guess  too  high,  no 
one  will  understand  the  material. 


The  subject  matter  experts  and 
the  resident  instructors  should 
have  a  feel  for  the  audience.  They 
should  have  the  final  judgment 
and  should  work  to  insure  that  the 
reading  level  of  the  lesson  does 
not  exceed  the  expected  reading 
level  of  the  target  audience.  "o 
assist  this  process  a  method  such 
as  FORECAST  may  be  useful. 

FORECAST  was  developed  for 
the  Army  and  ha^  been  validated 
and  cross-validated.  It  is  a 
quality  control  tool  used  to  check 
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AUDUNCC.  CObISIVl  RATIONS 


the  reading  level  (and  possibly,  the 
comprehension  level)  of  verbal  material. 
Use  FORFCAST  to  check  completed  material 
and  to  establish  a  criterion  to  direct 
TtC  lesson  development. 


General  Instructions 

Select  a  150  word  passage  from  connected  discourse.  Do  not 
use  this  formula  to  check  unconnected  statements.  It's 
best  to  start  counting  words  at  the  beginning  of  a  paragraph 
or  section. 

Counting  the  Words: 

Words  include  numbers,  letters,  symbols,  and  groups  of 
letters  that  are  surrounded  by  white  spaces.  Hyphenated 
words  and  contractions  are  counted  as  one  word:  "couldn't", 
"F.O.B.",  "$32,008",  "second  grade". 


Counting  the  Syllables: 

Count  syllables  the  way  the  word  is  pronounced:  such  as 
"row"  has  one  syllable,  "mention"  has  two.  With  symbols  and 
figures  the  syllables  are  known  by  the  way  they  normally  read 
aloud,  such  as,  one  syllable  for  ("cents"),  three  fot  R.F.D. 
("are-eff-dee") ,  and  four  for  1518  ("nineteen  eighteen"). 

When  in  doubt  about  syllables,  consult  a  dictionary. 


Step  1.  Count  the  number  of  one  syllabic  words  in  a  150-word 
passage. 

Step  2.  Divide  the  number  by  10. 

Step  3.  Subtract  the  result  from  20  to  obtain  the  reading  grade 
level . 


adapted  from  Kern,  Sticlit,  Welly,  f,  llauhc,  1975. 


Nomenclative .  Only  necessary 
technical  terms  should  be  placed 
in  the  TEC  lessons.  Any  terms 
or  phrases  peculiar  to  the  Army 
and  the  MOS,  however,  can  be  used. 
All  such  terms  should  be  fully 
explained  to  help  the  student 
understand.  Special  abbreviations 
or  acronyms  may  require  an  ex¬ 
planation  of  the  phonetics. 


Caylor,  J.  S.,  Sticht,  T.  G.,  Fox,  L.  C.,  &  Ford,  J.  P.  Methodologies  for 
determining  reading  requirements  of  mi  1 i tary  occupational  specialities 
(TUirnRRO - TR-73-5)  -  Alexandria,  Virginia:  Human  Resources  Research 
Organization,  March  1973*  (Pp.  5-18  describe  how  FORECAST  was 
developed  and  how  it  was  validated.) 

Kern,  R.  P.,  Sticht,  T.  G.,  Welty,  D.  ,  &  Haube,  R.  N.  Guidebook  for  the 
development  of  Army  training  literature.  Alexandria,  Viriginia: 

Human  Resources  Research  Organization,  November  1975-  (This  re¬ 
ference  illustrates  the  FORECAST  method.) 

Kincaid,  J.  P. ,  Fisburne,  R.  P. ,  Jr.,  Rodgers,  R.  L.,  &  Chissom,  B.  S. 
Derivation  of  new  readability  formulas  for  Navy  enlisted  personnel 
(Research  Branch  Report).  Millington,  Tennessee:  Chief  of  Naval 
Technical  Training,  February  1975-  (AD  A006  655)  (This  report 
describes  how  to  compute  three  readability  formulas  -  the  Automated 
Readability  Index  (ARI),  the  Fog  Count,  and  the  Flesch  Reading 
Ease  Formula.) 


A  .  1  .  *4  Self-Evaluation 


SELF-EVALUATION  =  STUDENT  PARTICIPATION 

•  USE  REVIEW  QUESTIONS 

APPLY  PROGRAMMED  INSTRUCTION 
«  PRINCIPLES 


Structure  the  self-evalua¬ 
tion  to  maximize  the  active 
participation  of  the  trainee 
and  to  insure  his  involvement 
in  the  lesson  content.  The 
self-evaluation  should  ask 
the  student  what  he  has 
learned,  provide  him  with  the 
correct  answer,  and  tell  why 
it  is  correct.  Applying  the 
principles  of  programmed  instruc¬ 
tion  is  one  systematic  way  to  as¬ 
sure  both  the  trainee's  involve¬ 
ment  and  the  trarsfer  of  information, 
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Qiu.z  SVmcAuML.  To  effectively 
teach  the  training  objectives,  your 
TEC  lessons  must  include  active 
audience  participation.  Review 
questions  can  provide  this  partici¬ 
pation  when  well  constructed  and 
placed  appropriately  in  the  lesson. 
Review  questions  should  be  presented 
immediately  after  each  new  procedure 
or  idea  (i.£.  ,  learning  objective) 
with  the  trainee  given  time  to  ans¬ 
wer  (a  pause  in  AC  or  AV  and  an 
answer  key  in  a  PT) .  At  the  end 
of  the  lesson,  a  quiz  that  covers 
the  entire  lesson  should  be  pre¬ 
sented.  The  quiz  should  include 
feedback  to  the  student. 

Quizzes  within  a  TEC  lesson 
are  not  mandatory  and,  of  course, 
some  lessons  do  not  require  them. 

For  example,  a  JPA  has  no  review 
questions  because  the  purpose  of  a 
JPA  is  to  assist  an  individual  in 
the  performance  of  a  task.  On  the 
other  hand,  a  JPA  demands  continuous 
audience  participation. 


•  USE  REVIEW  QUESTIONS  THROUGHOUT 
LESSON 

•  PLACE  QUIZ  AT  THE  END  OF  THE 
LESSON 


A  Sij6tc.mcuU.C-  Approach.  One 
systematic  approach  that  is  useful 
for  structuring  review  questions  is 
programmed  instruction.  By  using 
the  principles  of  this  technique, 
you  can  directly  involve  the  student 
in  the  lesson.  Basically  programmed 
instruction  presents  the  student 
with  informant  ion  to  which  he  must 
respond  before  he  can  proceed  with 
the  rest  of  the  lesson.  Then  the 
student  is  given  the  correct  answer. 

He  then  proceeds  to  the  next  piece 
of  information.  The  programmed  in¬ 
struction  approach  allows  the  student 
to  proceed  at  his  own  pace  and  requires 
that  he  actively  participate  in  the 
lesson.  The  question/answer  feedback 
and  student  participation  facilitate 
the  learning  of  the  lesson  objective. 


•  PRESENT  INFORMATION  IN  UNITS. 

•  ASK  A  QUESTION  BASED  ON  THAT 
INFORMATION.  THIS  PERMITS  THE 
STUDENT  TO  ACTIVELY  RESPOND. 

•  AFTER  ALLOWING. THE  STUDENT  THE 
OPPORTUNITY  TO  RESPOND,  GIVE 
THE  CORRECT  ANSWER,  AND  EXPLAIN 
WHY  IT  IS  CORRFCT.  CONTINUE 

IN  THE  SAME  MANNER  FOR  THE  RE¬ 
MAINING  INFORMATION  UNITS. 

»  PRESENT  A  COMPLETE  QUESTION/ANSWER 
REVIEW  IMMEDIATELY  AFTER  THE 
LESSON  HAS  ENDED. 
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TRADOC  PAMPHLET  350-30.  ISP:  Phase  IV.  Fort  Monroe,  Virginia:  U.  S 
Army  Training  and  Doctrine  Command,  August  1975.  (Programmed  in¬ 
struction  is  discussed  on  pp.  246-247.) 


4.1.5  Level  of  Pictorial  Pet a i J_ 

Guidelines  for  pictorial  de¬ 
tail  are  required  for  all  lessons 
involving  visuals. 


e  STRIKE  A  BALANCE  BETWEEN  QUALITY 
AND  DETAIL.  VISUALS  (ESPECIALLY 
PHOTOGRAPHS)  MAY  INADVERTENTLY 
HIDE  A  CRITICAL  FACTOR  IN  SHOWING 
REQUIRED  RELATIONSHIPS. 

•  NEVER  USE  VISUALS  TO  EMPHASIZE  A 
POINT  OF  VIEW  THAT  THE  TECHNICIAN 
WILL  NEVER  ACTUALLY  SEE. 


RdaLUtn  and  School  Ac c.ejt- 
abttitj.  How  realistic  do  the 
visuals  have  to  be  in  order  to 
teach  the  lesson  objectives? 

Your  might  assume  that  the  more 
realistic  the  illustration,  the 
greater  the  probability  that 
learning  will  occur.  This  is 
not  necessarily  true.  One  study 
authorized  by  ATSC  compared  two 
versions  of  the  same  TEC 
lesson.  One  version  contained 
complex  illustrations  with  ex¬ 
tensive  detail  and  background; 
the  other  had  simple  illustra¬ 
tions  with  background  and  uniform 
detail  removed.  The  results 
showed  there  were  no  differences 
in  learning  between  the  two 
lesson  types.  In  addition,  soldier' 
attitudes  toward  the  two  versions 
were  equivalent.  (See  Biege,  Borg, 

6  Schuller,  1977  for  details.) 
Therefore,  when  you  use  visuals 
you  should  be  more  concerned  about 
the  suitability  of  the  information 
content  than  with  the  detail  of 
the  visuals. 
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Even  though  these  data 
show  the  drawings  do  not 
have  to  be  exact  to  train 
soldiers,  some  schools 
believe  any  decpiction 
of  soldiers  and  equip¬ 
ment  should  be  100%  ac¬ 
curate.  For  example, 
it  may  be  a  waste  of  time 
and  money  to  draw  a  de¬ 
tailed  picture  of  M60A1 
Lank  to  illustrate  the 
location  of  the  two 
machine  guns  when  a  out¬ 
line  drawing  would  suf¬ 
fice.  There  will  be 
times,  however,  when 
exact  detail  is  essential. 
For  example,  a  lesson  on 
how  to  dress  properly 
would  require  a  pro¬ 
perly  dressed  soldier. 

On  the  other  hand,  a 
lesson  showing  the  opera¬ 
tion  of  a  squad  rod io 
should  place  more  em¬ 
phasis  on  the  drawing 
of  t!ie  squad  radio  than 
on  the  soldier  operating 
i t .  The  TEC  manager 
should  use  the  minimum 
level  of  detail  which  is: 

(a)  believed  by  SMEs  to 
be  effective  and  (b)  ac¬ 
ceptable  to  school  person- 
ne  I  . 


IS  THERE  A  DIFFERNECE  IN  TEACHING  VALUE? 


CALIBER  .50 
MACHINEGUN  <M85i 


[7.62  MM  COAX 
MACHINEGUN 


PFTAILFD  VISUA1 


CALIBER  .50 
MACHINEGUN  (M85) 


7.62  MM  COAX 
MACHINEGUN 


OUTLINE  DRAWING 


BALANCING  A  VISUAL 
j  mo s  m7s match lO 

DIVERSE  MISSIONS\ 

[  COMPLEX  P0CTRINE1 
i  EQUIPMENT  DENSITY  \ 

low  manning  levels  \ 

I  TTfGH  personnel  turnover  ' 

~  LIMITED  TRAINING  RESOURCES 
ADMINISTRATIVE  REQUIREMENTS 
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INFORMALLY 


Uip  oi  the  Gtapluc  AnXi> 

Giudance  K-Lt .  Visuals  should 
generally  complement  and  illu¬ 
strate  the  narration  by  effec¬ 
tively  using  harmony,  contrast, 
balance,  emphasis,  and  shape. 

A  harmonious  display  is  com¬ 
posed  of  coordinated  elements 
(lettering,  color,  etc.).  Con¬ 
trast  uses  light  and  dark  elements 
to  del ‘mate  the  forms  in  the  visuals 
Balance  can  either  be  formal  (a 
symmetrical  arrangement  of  all 
elements),  or  informal  (elements 
appear  balanced  although  each  side 
of  the  arrangement  is  different). 
Emphasis  refers  to  the  proper  use  of 
lettering,  color,  or  other  direc¬ 
tional  aids  to  stress  a  central 
idea.  Shaping  means  guiding  the 
viewer  through  a  visual  in  proper 
sequence.  The  Graphic  Arts  Guidance 
Kit  (GAGK)  provides  you  with 
detailed  standards  for  using  those 
characteristics  to  develop  quality 
v i sun  I s . 


GAGK  is  availabe  from  ATSC-TPD 
and  you  should  consult  it  for 
specific  guidance  when  developing 
or  monitoring  the  development  of 
the  TCC  lesson  visuals.  Although 
designed  to  provide  uniform 
standards  for  TEC  Beseler  Cue/See 
lesson  visuals.  GAGK  can  be 
applied  to  any  of  three  TEC  modes  - 
AV,  PT,  and  JPA. 


CONTENTS  0F”GAGK 
Audiovi  sual 

A.  Semi -Comprehensive  Art 

B.  Final  Art 

1.  Beseler  Cue/See  Field  Guide 

2.  Final  Art  Aspect  Ratios 

3.  Registration 

4.  Resolution 

5.  Type 

6.  Color  and  Contrast 

7.  Graphic  Style  and  Photography 

8.  Animation  and  Motion  Pictures 

9.  Laboratory 

Printed  Texts 

A.  Visual  Dummy 

B.  Master  Mechanical 


Bib t Log kapli ij  joK  4. 1 . 5_ 

TPD  Graphic  Arts  Guidance  Kit  (GAGK).  Fort  Eustis,  Virginia:  U.  S. 
Army  Training  Support  Center  -  Training  Programs  Directorate, 

(no  date  available).  (A  kit  which  presents  information  in  three 
media:  printed,  super  8  mni,  anJ  35  mm  slides.) 


The  use  of  detail  and 


background  in  visuals  and  its  effect  on  learner  achievement  and 

attitude.  Fort  Eustis,  Virginia:  IJ.  S.  Army  Training  Support 
Center,  April  1977.  (The  complete  results  of  the  ATSC  study 
on  detail  level  in  TEC  lessons.) 
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AN  AV  TEC  LESSON  IS  A  FUNCTION  OF: 


L 


LENGTH 

-  rORMAT  AND  PRESENTATION 

-  ANIMATED/MOTION  SEQUENCES 

-  VISUAL  DEVELOPMENT  CYCLE 

-  STIMULUS/RESPONSE  TIME 

-  SCRIPT 


GRAPHIC  ARTS 

-  COLOR 

-  CONTRAST 


AUDIO  PROCEDURES 

-  RUNNING  TIME 

-  CUFING 


«  SINGLE  FRAME  SHOULD  NOT  REMAIN 
ON  THE  SCREEN  LONGER  THAN  20 
SECONDS 


©  THE  AUDIO  PORTION  ACCOMPANYING 
EACH  FRAME  SHOULD  NOT  EXCEED 
20  SECONDS 


•'•“36 


A.  2  AV  TEC  LESSON  DESIGN- 


Section  A.l  presented 
criteria  that  can  be  applied  to 
all  TEC  lessons  to  insure  the 
development  of  an  effective  les'son. 
This  section  presents  criteria 
specific  to  AV  TF.C  lessens.  The 
three  subsections  provide  guidance 
on  lesson  length,  graphic  art 
evaluation  and  audio  technical 
procedures . 


A. 2.1  AV  Lesson  Length 


The  general  con 
for  the  length  of  AV 
are  presented  in  Sec 
The  format  of  AV  les 
ever,  is  based  on  th 
tion  of  individual  f 
number  of  animation 
sequences,  the  numbe 
of  visuals,  the  arr.ou 
stimulus  and  respons 
the  length  of  the  sc 
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format  and  PncAc.ntcUd.on.  The 


AV  format  is  a  system  of  slides 
(Super  8)  with  auditory  narrations. 
According  to  the  I S D  manual  (Block 
III. A),  you  should  avoid  displaying 
a  single  frame  longer  than  20 
seconds.  Otherwise,  the  audience 
will  become  bored  and  distracted 
from  the  subject  matter.  If 
narrations  are  related  to  the 
visuals  and  must  exceed  20  seconds, 
then  use  2  or  more  similar  visuals 
(e.g.,  the  same  equipment  viewed 
from  a  different  angle). 
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about  20  seconds  per  frame  exposure, 
narration  length  is  also  dependent 
on  speech  rate  and  pauses  within 
the  narration.  Average  speech  rate 
is  about  120  words  a  minute.  A 
comfortable  range  for  most  audiences 
is  100  to  I  AO  words  a  minute.  Ap¬ 
propriately  placed  pauses  will  give 
your  listeners  an  opportunity  to 
digest  the  information  presented. 

Normally  TEC  lesson  narrators 
should  possess  a  wide  range  t>f  fre¬ 
quencies  within  their  normal  speaking 
voice.  Use  of  a  voice  which  pro¬ 
duces  mostly  high  frequencies  or 
mostly  low  frequencies  can  be  annoying 
and  thus  distract  from  the  teaching 
potential  of  the  lesson.  If  you 
have  special  requirements  for  the 
voice  quality  of  the  narrator  (e^.£.  , 
an  authoritarian  type  voice)  make 
those  requirements  known  before  the 
TEC  lesion  goes  into  reproduction. 


Ai Umation  and  Motion.  A  unique 


feature  of  the  Bescler  Cue/See  is  its 
capability  to  display  animated  and 
motion  sequences.  An  animated  sequence 
consists  of  multiple  art  visuals  shown 
in  rapid  succession,  whereas  a  motion 
sequence  is  a  motion  picture  film  clip. 
Use  these  techniques  only  when  they 
add  something'  to  the  lesson.  For  ex¬ 
ample,  an  animated  or  a  motion  sequence 
of  acquiring  and  tracking  an  aircraft 
would  help  the  student  learn  air 
defense  tactics.  On  the  other  hand, 
the  value  of  using  an  animated  or  a 
motion  sequence  to  display  the  com¬ 
ponents  of  an  Ml  6  A 1  rifle  would  be 
questionable.  GAGK  provides  specific 
guidance  for  using  animated  and  motion 
sequences . 


KEEP  THE  SPEECH  RATE  FOR  THE 
NARRATION  AROUND  120  W0P0S  A 
MINUTE 


Ail  I  MAT  I  ON  AND  MOTION 
CAN  AID  LEARNING 
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lA'/Sttgl.  VevztopmQilt  Cijcit.  De¬ 
velopment  of  AV  visuals  is  an  iterative 
process  that  does  not  begin  until  a 
lesson  has  been  outlined  and  narration 
has  been  defined.  To  the  extent 
possible,  you  start  by  determining 
the  number  and  kind  of  visuals  needed 
to  support  the  narrative.  For  contract 
development,  it  is  important  to  con¬ 
vey  the  kind  and  number  of  visuals 
you  have  in  mind.  Otherwise,  you 
may  receive  multiple  visuals  where 
one  would  suffice. 

The  art  development  cycle  starts 
with  a  verbal  description  of  an  idea, 
continues  from  a  thumb-nail  sketch  to 
a  rough  sketched  line  drawing,  and 
finally  to  a  finished  product.  The 
rough  sketch  is  later  replaced  with 
a  semi  comprehens  i  vc  art,  i.e.  ,  fill  ed  - 
in  color  illustrations.  The  last 
stage  (final  art)  is  a  true  rendering 
of  precise  line  work  or  a  full  color 
photograph. 
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TEC,  visuals  are  used  to  supple¬ 
ment  and  complement  t he  narrative. 
This  affects  che  division  of 
stimulus  and  response  times.  While 
this  division  should  follow  the 
general  guidance  of  Section  4.1, 
the  specific  guidelines  given 
below  apply. 


•  NARRATION  (AUDIO)  SHOULD  BE  USED  TO  EXPLAIN  DETAILS,  SUGGEST  RELATION¬ 
SHIPS,  AND  SUPPLY  INFORMATION  NOT  EXPLAINED  IN  THE  VISUALS. 

•  USE  THE  NARRATION  TO  IDENTIFY  OR  DESCRIBE  THE  CONTENT  Or  A  VISUAL 
AS  SOON  AS  THE  VISUAL  APPEARS.  DO  MOT  MAKE  THE  AUDIENCE  GUESS  WHAT 
THE  CONTENT  OF  A  VISUAL  IS  ALL  ABOUT.  TELL  THEM. 

e  NARRATION  SHOULD  ALWAYS  BE  SIMPLY  WRITTEN,  DO  NOT  USE  LONG,  COMPLICATED 
SENTENCE  STRUCTURES  WITH  MULTIPLE  CLAUSES.  USE  A  SIMPLE  VOCABULARY. 

TRY  TO  STRIKE  A  BALANCE  BETWEEN  COMPLETENESS  AND  SIMPLICITY  WITHOUT 
TALKING  DOWN  TO  THE  AUDIENCE. 

•  VARY  THE  PACE  OF  THE  NARRATION.  ALLOW  FOR  BREAKS  OF  SILENCE  TO 
BRIDGE  DIFFERENT  VISUALS. 

e  CHOOSE  WORDS  CAREFULLY.  WORDS  IMPROPERLY  CHOSEN  MAY  EVOKE  AN  ERRONEOUS 
MENTAL  PICTURE  OF  AN  IDEA  OR  RELATIONSHIP. 


•  AVERAGE  KIT  LENGTH:  25  MINUTES 
STIMULUS  TIME  AND  45  MINUTES  OF 
STUDENT  RESPONSE  TIME. 

«  MINIMUM  KIT  LENGTH:  15  MINUTES 
STIMULUS  TIME  AND  30  MINUTES  OF 
STUDENT  RESPONSE  TIME. 

•  MAXIMUM  KIT  LENGTH:  40  MINUTES 
STIMULUS  TIME  AND  90  MINUTES  OF 
STUDENT  RESPONSE  TIME. 

•  USE  SHORTER  KIT  LENGTH  TIMES  IF 
THERE  IS  NO  HANDS-ON  PRACTICE 
COMPONENT . 


A  recent  TEC  request  for  pro¬ 
posal  (RFP)  lists  average,  minimum, 
and  maximum  kit  lengths  (see  box 
at  left)  in  terms  of  nar rat  ion  (s t i mul u 
and  student  response  time  for  kits 
involving  hands-on  practice.  With¬ 
out  a  hands-on  component  your  kit 
should  not  exceed  the  previously 
noted  20-30  minute  maximum. 
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TPD  Graphic  arts  guidance  kit  (GAGK).  Fort  Eustis,  Virginia:  U.  S. 
Training  Support  Center  -  Training  Programs  Directorate,  (no  dat 
available).  (Pp.  2^-25  discuss  the  technical  aspects  of  anima 
and  motion.  Pp.  1-25  describe  the  technical  aspects  of  semi- 
comprehensive  art  and  final  art.) 

TRAIOC  PAMPHLET  350-30.  ISP  Phase  111.  Fort  Monroe,  Virginia:  U.  S 
Army  Training  and  Doctrine  Command,  August  1975.  (Pp.  239-2M  d 
cuss  stimulus  time  for  visuals.) 

Consult  recent  TEC  Request  for  Proposals  (RFPs)  for  any  specific  guid 
that  may  be  included  for  st imulus/response  times. 


h.2.2  AV  Graphic  Arts 

Although  the  GAGK  contains 
specific  criteria  for  graphic 
arts,  general  technical  criteria 
on  color  usage  and  contrast  may 
also  assist  your  development  of 
AV  v i sua 1 s . 


«  U3E  COLOR  FOR  STIMULATION 


a  superiority  of  color  presentations 
over  black  and  white  ones.  Color 
does,  however,  seem  to  vitalize 
lesson  content  and  to  stimulate  the 
user.  On  the  other  hand,  careless 
use  of  color  may  destroy  its  value. 
(See  GAGK  for  35  mm  slides  of 
representative  colors  and  palettes.) 

Contncbbt.  Strong  contrasts 
should  be  used  to  emphasize  im¬ 
portant  information  (i.e^.  ,  the 
main  theme  of  a  frame)".  Subtle 
contrasts  are  more  appropriate  for 
supplemental  information.  Pro¬ 
jected  slides  are  less  fatiguing 
to  the  eye  when  light  lettering 
on  dark  background  is  used. 


TPD  Graphic  arts  guidance  kit  (GAGK).  Fort  Eustis,  Virginia:  U.  S.  Army 
Training  Support  Center  -  Training  Programs  Directorate  (no  date 
available).  (Pp.  16-20  discuss  resolution  and  type  as  they  pertain 
to  the  Beseler  Cue/See.  Pp.  21-22  discuss  color  and  contrast. 

Examples  of  color  usage  and  contrasts  arc  provided  in  35  mm  and  Super 
8  mm. ) 

A. 2,3  Audio  Technical  Considerations 
of  AV  Lessons 

Synchronization,  running  time, 
and  cueing  can  be  used  to  assist 
student  interaction  with  the  Beseler 
Cue/See.  Properly  applied,  these 
will  insure  ease  of  operation  of  the 
Beseler  and  thus,  contribute  to  user 
acceptab i 1 i ty . 
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Al/  TECHNICAL  CONS WEMTI OHS 


V 

SyndiSi.ouizction .  Because 
AV  lessons  a^e  a  combi nat ion  of 
two  media,  you  must  insure  the 
quality  of  both.  Of  particular 
concern  is  the  physical  synchroni¬ 
zation  of  the  audio  to  the  video.  •  SYNCHRONIZE  « HE  NARRATION 

The  audiotape  contains  the  in-  TO  THE  VISUALS 

audible  pulses  to  advance  the  - - - 

Super  8  film  cartridge.  There¬ 
fore,  when  you  review  the  TEC 
kit  in  the  Super  8  format  you 
have  to  verify  that  the  pulses 
do  advance  the  video  portion  to 
the  correct  frame  at  the  correct 
time. 


Cue  A  no .  Normally,  the 
audio  track  automatically  cues 
the  visual  track  to  advance, 
but  the  pause  feature  of  the 
Beseler  Cue/See  system  stops 
both  tracks  and  requires  manual 
cueing  to  continue.  In  this 
case,  you  have  to  provide, 
within  the  script,  audio  di¬ 
rections  on  how  to  proceed. 

Do  not  assume  that  ever/one 
has  used  a  Beseler  Cue/See 
before.  You  can  provide 
a  general  instruction  at  the 
beginning  of  a  lesson  (£.£., 
"whenever  the  green  light 
comes  on  you  may  proceed  when 
you  are  ready")  or  you  can 
remind  the  student  to  press 
the  proceed  button  at  every 
stop  point. 


«  PROVIDE  VERBAL  CUEING 
INSTRUCTIONS 


A -A 3 


4.3  AO  TEC  LESSON  DESIGN 


AN  AO  TEC  LESSON  IS  A  FUNCTION  OF: 

1 .  LENGTH 

-  FORMAT  AND  DEVELOPMENT 

-  STIMULUS/ RESPONSE  TIME 

2.  TECHNICAL  PROCEDURES 

-  RUNNING  TIME 

-  CUEING 


The  criteria  that  you  can 
apply  to  AO  lessons  under  de¬ 
velopment  are  length,  running 
time,  and  cueing.  The  length 
criteria  are  described  in  terms 
of  format  and  development,  and 
st imu 1  us/response  time.  As  with 
the  audio  track  of  AV  lessons, 

;he  AO  technical  procedures  are 
running  tine  and  cueing  procedures 


4.3-1  AO  Lesson  Developmen t 


FomaX  and  V2.vcl0pme.nt. 

Choosing  the  AO  meduim  for  lesson 
development  limits  your  design  free¬ 
dom.  Because  the  entire  lesson  is 
in  audio,  lessons  have  to  employ 
techniques  stimulating  to  the 
auditory  sense.  Effective  lessons 
will  depend  on  the  proper  use  of 
music,  sound  effects,  voice  intensity 
and  pacing.  Audio  lesssons  can 
be  especial ly  useful  as  a  JPA  or 
a  procedural  guide  which  supports 
e i  ther  an  AV  or  PT  lesson. 

The  development  process  for  AO 
lessons  requires  precise  and  clear 
verbal  explanation  of  learning 
objectives  and  learning  steps.  Your 
verbal  explanations  should  be  or¬ 
ganized  into  a  written  script.  This 
procedure  allows  you  to  examine 
everything  that  will  be  taught 
aurally  and  to  edit  accordingly. 
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SU  ,ulti6 /Re'S pome.  T-onc..  I n 
AO  lessons  the  narrative  should 
be  flowing,  well  paced,  and  in¬ 
tegrated  with  review  questions 
and  practical  exercises.  This 
method  will  actively  involve 
the  student  in  the  lesson  and 
reduce  boredom.  Guidelines 
for  your  AO  lesson  length, 
according  to  a  TEC  RFP,  are 
the  same  as  the  AV  guidelines 
(See  4.2.1)  . 


e  AVERAGE  KIT  LENGTH:  25  MINUTES 
STIMULUS  TIME  AND  45  MINUTES  OF 
STUDENT  RESPONSE  TIME 

•  MINIMUM  KIT  LENGTH:  15  MINUTES 
STIMULUS  TIME  AND  30  MINUTES  OF 
STUDENT  RESPONSE  TIME 

•  MAXIMUM  KIT  LENGTH:  40  MINUTES 
STIMULUS  TIME  AND  90  MINUTES  OF 
STUDENT  RESPONSE  TIME 

•  MODIFY  ABOVE  KIT  LENGTHS  IF  NO 
HANDS-ON  COMPONENT  IS  INCLUDED 


BibfUognapluj  ( (pa.  4.3.? 

TRADOC  PAMPHLET  350"30.  I SD :  Phase  111.  Fort  Monroe,  Virginia: 
Army  Training  and  Doctrine  rc  -and,  August  1975-  (Pp.  230-232 
discuss  the  development  c  a  ,'io  only  materials.) 

Consult  Recent  TEC  Request  for  Proposals  (RFPs)  for  any  specific 
guidance  that  may  be  included  for  stimulus/response  time. 


4.3.2  Audio  Technical  Considerations 


Rumung  Acme,.  With  AO  les¬ 
sons,  the  student  has  full  control 
over  the  player  operation.  There¬ 
fore,  you  can  have  instructional 
material  presented  on  both  sides 
of  the  tape  cassette.  For  case 
of  operation,  however,  you  should 
try  to  limit  a  single  kit  to 
the  running  time  of  one  side  of 
th"  tape  cassette  (30,45,  or  60 
minutes  per  side). 

CtieAng .  Unlike  AV  lessons, 

A0  lessons  do  not  automatically 
stop  at  cued  points  in  the  tape. 
You  will  have  to  insure  that  the 
audio  script  includes  the  neces¬ 
sary  audio  comments.  For  ex¬ 
ample,  if  your  lesson  has  review 
questions  or  requests  that  a 
particular  procedure  be.  carried 
out,  then  you  will  have  to  tell 


the  student  to  turn  the  player 
off  until  he  is  ready  to  pro¬ 
ceed,  e.g.,  "turn  me  off  until 
you  are  ready  to  go  on  to  the 
next  step".  In  addition,  if 
the  tape  is  recorded  on  both 
sides,  provide  script  that 
directs  the  student  to  turn 
the  tape  over,  e_.g.,  "this  is 
the  end  of  side  1  of  TEC 
lesson  xxx  -  xxx,  turn  me  over 
for  the  continuation  of  (lesson 
title) 


PT  TEC  LESSON  DESIGN 


PT  lesson  development  is 
very  similar  to  AV  lesson  de¬ 
velopment.  The  general  criteria 
given  in  Section  h .  I  apply,  as 
well  as  unique  length  criteria 
and  graphics. 


A  PT  TEC  LESSON  IS  A  FUNCTION  OF: 

1 .  LENGTH 

-  DEVELOPMENT  PROCESS 

-  STIMULUS/RESPONSE  TIME 

-  FORMAT 

2.  GRAPHIC  ARTS 

-  COLOR 

-  CONTRAST 

-  PRINT  AND  LINE  SPECIFICATIONS 


1  PT  Lesson  Development 


PT  length  is  a  function  of 
the  lesson  development  process. 
In  particular,  you  should  evalu¬ 
ate  the  length  requirement  ac¬ 
cording  to  the  stimulus/re¬ 
sponse  guidelines  and  use  the 
lessen  format  procedures  to 
determine  how  the  layout  will 
alter  overall  lesson  length. 


■*’.  **.  •.*-  •%  ■c.  ** .  *. . 

•>  r.-  r .  -J.  -> 


*  DEVELOP  PT  LESSONS  LIKE  AV 

LESSONS 

!  •  RELY  HEAVILY  ON  VISUALS  TO 
I  CONVEY  THE  LESSON  INFORMATION 


Lcaon  Vo v el c pn out  PstoceA6. 

PT  lesson  development  should  parallel 
the  AV  lesson  development  process. 

A  manuscript  is  composed  from  the 


CCSS.  From  the  manuscript,  a 
visual  dummy  (comparable  to  the 


storyboard  in  the  AV  lesson  de¬ 
velopment  process)  of  print  and 
visuals  is  developed.  The 
final  stage  is  the  camera-ready 
copy  or  master  mechanical  which 
is  developed  from  the  visual 
dummy.  The  GAGK  provides  com¬ 
plete  instrutions  for  developing 
a  master  mechanical. 


Care  should  be  taken  in  de¬ 
ciding  to  use  PT  lessons  in  any 
particular  MOS  because  some 
soldiers  may  have  difficulty 
understanding  printed  material.  You 
should  emphasize  the  pictorial  com¬ 
ponent  rather  than  the  verbal  com- 
ponen  t . 

Stinii.Pig/  lie  a  po  n&e  T-one.  PT 
lesson  construction  should  parallel 
AV  lesson  construction.  In  fact, 
a  PT  lesson  may  be  an  exact  hard 
copy  of  an  AV  lesson,  ,  ex¬ 

tensive  visuals  with  the  accompanying 
printed  narration.  Because  PT  lessons 
arc  completely  self-paced,  exercise 
caution  when  deciding  on  overall 
length;  the  length  is  a  function  of 
individual  reading  speed  (average 
reading  speed  for  the  U.  S.  adult 
is  200-300  words  per  minute)  and 
study  time  of  the  accompanying  visual 
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PT  LESSON  DEVELOPMENT 


L 06i on  Format.  The 
critical  factor  in  preparing 
PT  lessons  is  page  layout. 
Based  on  the  guidelines 
from  a  human  factors  hand¬ 
book,  the  user  of  the  lesson 
visually  enters  each  page 
at  the  upper  left-hand 
corner.  Therefore,  attention 
should  be  focused  on  the 
reader's  interest  point,  , 

us:ng  an  attention-getting 
lead-off  visual  to  direct  the 
reader  through  the  material. 


TWO  TYPICAL  PT  FRAMES  FROM  TEC  LESSONS 


l.J  In  |j»  t.  whrthrr  y«*i  Mm*  to  m  A r t ivr  Army  nr  Componmt  unit,  ((•<•  n'unlwr  of 

l«  rtir.  >4  I  mining  i*  not  .m^rant.  What  i»  important  /«  -  can  |t.#  holder  nr  IK  unit  do  tha  jnli' 
Tht.  ionfrnlr»ti.i<  ’•■•ur  Iramin*  on  critic  il  l.uki  which  right  nnw  your  wJd.om  i  *nr»>t 
I**  rf*»rm.  nr  .Villa  lh**y  row*’  i".»  which  tlwy  do  not  h*v#.  *  I 


Adapted  from  Woodson  £  Conover,  1970. 


PT  GRAPHIC  ARTS 


TPD  Graphic  arts  guidance  kit  (GAGK) .  Fort  Eustis,  Virginia’  U.  $. 
Army  Training  Support  Center  -  Training  Programs  Directorate  (no 
date  available).  (Pp.  29 ~ 3 1  discuss  technical  guidelines  for 
pr i nted  texts . ) 

Woodson,  W.  E.  &  Conover,  [).  W.  Human  engineering  guide  for  equipment 

des igners  (2nd  ed.).  Berkeley,  California:  University  of  California 
Press,  1970.  (Contains  a  section  on  formatting  printed  material.) 


*4. *4. 2  PT  Graphic  Arts 


Graphic  arts  for  PT  lessons  can 
be  evaluated  in  terms  of  color  usage, 
contrast  and  print/line  specifications 


Colo A  Usage.  ((The  criteria 
presented  for  A V  lessons  are  appro¬ 
priate.  See  sections  *4.1.3,  *4.2.2, 
and  GAGK  for  specific  guidance)). 


®  USE  DARK  PRINT  ON  I  I OUT  BACK¬ 
GROUND 

•  USE  BLACK  PRINT  ON  HIGHLY  RE¬ 
FLECTING  BUT  NON-GLOSSY  WHITE 
PAPER 

•  USE  PAPER  OP  SUFFICIENT  WEIGHT 
TO  AVOID  BLEED-THROUGH  OF  PRINT 
FROM  THE  OPPOSITE  SIDE  OF  PACE 


Ccnvt/UUt.  Most  of  the  time, 

PT  lessons  will  use  a  black  and 
white  medium.  Therefore,  your 
use  of  contrast  will  be  important 
for  conveying  the  lesson  objectives. 


The  following  table  presents  detailed 
recommendations  for  designing  printed 
materia]  (Woodson  6  Conover,  1970): 


FRINT  STYIE 

Vertlcol  (romcnj  print  it  rcc 
ommimded  for  normol  use. 
Holies  ore  permissible  for 
specie!  emphasis,  but  should 
be  used  sporingty 

BooVmon  Old  Style 

Garomond 

Cheltenham 

Antique 

Scotch  Roman 

(Styles  under  labels,  etc.,  con 
also  be  used  for  heodings, 
graphs,  lables,  etc  ) 

PPINT  fORM 

Combinations  of  ropifol  and 
lower-case  letters 

PRINT  SIZE 

10  point  type  preferred;  9 
to  12  point*  permissible. 

(1  point  rj:  0.0138  Inch.) 

IINE  IENCTH 

19  picas  preferred;  14  to  28 
picas  permissible. 

(1  pica  0.166  inch)  | 

LINE  SPACING 

With  10-point  typo,  space  be¬ 
tween  lines  should  not  be  lets 
thon  2  points. 

BibC LognajJuj  fid  4.4.2 

Virginia:  U.  S. 
Directorate,  (no 
and  contrast.) 


TPD  Graphic  arts  guidance  kit  (GAGK) .  Fort  Fust  is. 
Army  Training  Support  Center  -  Training  Programs 
date  available).  (Pp.  21-22  discuss  color  usage 


Woodson,  W.  E.  t  Conover,  D.  W.  Human  engineering  guide  for  equipment 

des  igners  (2nd  ed.)  Berkeley,  California:  University  of  California 
Press,  1970.  (Contains  guidelines  for  print  and  line  specifications.) 
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Presently  TEC  JPAs  are  only 
developed  in  one  medium,  print; 
although  all  media  are  likely 
candidates.  The  main  consideration 
is  deciding  when  a  JPA  is  appropriate 


^.5.1  The  Appropriateness  of  a  JPA 


USE  JPAs  FOR: 

•  BEHAVIOR  SEQUENCES  THAT  ARE  LONG 
AND  COMPLEX 

•  TASKS  THAT  ARE  RARELY  PERFORMED 

•  TASKS  THAT  INVOLVE  READINGS  AND 
TOLFRANCES 

•  TASKS  THAT  ARE  AIDED  BY  THE 
PRESENCE  OF  ILLUSTRATIONS 

0  TASKS  THAT  UTILIZE  REFERENCE 
INFORMATION,  SUCH  AS  TABLES, 
GRAPHS,  FLOWCHARTS,  AND 
SCHEMATICS 


VcjiiuXsion  and  Hie..  A  JPA  is 
any  device  which  permits  an  individual 
to  perform  a  task  he  would  not 
normally  he  able  to  do  without  ex¬ 
tensive  training  or  complex  problem 
solving.  A  JPA  can  be  a  set  of 
procedures,  charts,  tables  of  data, 
or  checklists  (the  most  common). 

A  specialized  use  of  a  JPA  is  the 
checklist  which  directs  the  individual 
through  the  major  steps  of  a  particular 
procedure.  When  used  as  part  of  an 
existing  TEC  lesson  the  checklist  is 
not  issued  as  a  separate  TEC  lesson. 
Rather,  it  supports  the  TEC  lesson 
and  serves  as  a  reminder.  The 
independent  TEC  JPA  is  a  TEC  lesson 
and  contains  all  the  information 
needed  to  perform  particular  tasks. 
Although  usually  in  a  printed-pictorial 
format,  you  can  also  construct  JPAs 
in  the  AO  and  AV  media.  Research 
has  shown  the  printed  pictorial  format 
to  be  the  most  cost-effective  medium, 
but,  the  task  itself  determines  the 
medium.  For  example,  a  procedure 
that  requires  hands-on  operation  (e.£.  , 
preparing  to  swim  a  tank)  can  be  per¬ 
formed  with  an  AO  checklist.  The 
cassette  player  is  attached  to 
the  student's  belt  and  the  ear  phone 
is  placed  in  his  ear.  This  leaves 
a  student's  hands  free  to  perforin 
all  needed  procedures. 


CONVENTIONAL  JPA 


SPECIALIZED  CHECKLIST 


LESSON  NO  936  06I0I3M 
TA-312  LO  OPERATION 

!  Remove 
ci>  Handset 

i  i'll  <«PUSH  10  REMOVE  |(V\  I 

\ § 

■■'rrrwi'/'i'  ivi'.v.'/1  ff.*'1 

Sot  The  3  Swilches 
cv  and  Install  Batteries 

zf  lsO  VWPi '  • 

I?  a  ,riM&  r  ;iVi , 

j\-  ,/  tjfcj  -l* ri 2$3 

Ly ■-*  §...  v. 

'  Will,  ounl 

:  •'<  Test  Batteries 

<  and  Handset 

I  « •**.*•  t»  tlVif  I  ..Vi-r 

•  I •»•  -w*  h  •••  1 4  l>  KHM 

.•  :-iy  mu  hiHK  ’IIM  It :lf 

I  |«  yi>u  do  II  I  In  M  »»*!».  +>t,  *.,!.•»  pit#  |'lltl'Nr% 
•'  |l  '.H  IM't  I f  llkilUJ.  ||  I  »|.p«fVIMV 


PIFKihM  THE  TUNING  IHOCEUuRE 
KN  PAT  f  StT  AN/Uf*C14?n 


S*t  SfhVICE  SFl  ECTOR  twin*  »©  VTAND.RY.  A/W  fO 

r-J'A.ti  frj#  d.tl  b>o*Nri  •> * 

and  th#  MQNAL  IfVfL  MEtlH  Indt****  in 

[NNtCA  Ot 

Pt  SEMVICP  SmCfUH  •  -•**#»  t®  WVNfX  S<r«< 

m f.wr  lu  »ttrfrm  l«'t  p - liort  of  rrwrt**  ki4 

C*.w»*  1S4*  TrST  METER  ind.r»>*  PRIM  VOLT  rudin*. 
C»>n  f»n,v*-«cp  t’lPR  CfO|  m»i  p**v*|  il*o  PHr  and  KHl 


f*'«1  tr^t  httlfl)!  lu*  ANT  TUN*  wxl  AjfT  10 -O  cowv 
hn  and  nJ/uit  ♦.*»*  ANT  TUNE  »nd  ANT  LOAD  |jnt*r4i 

UMil  tS*  (QuPtm  |.rl<*t«  (N  tvUiRyi, 

Sat  hJ  RESET  rwtcK  to  TUNS. 

OW-*'-*  IK*t  f>P*  Uf  toih  of  tN*  |*>’.nr*r»  or*  Oft  o*ni«r 
kN>«  on  |N#  ANT  TUN;  *»hI  ANT  LOAD 

AJjLtt  AST  10 Ail  and  /.NT  TUNE  for 

*wt  c«n!**  k*l»  2  W'inuto  CJuimt  a«N(W 

•djuatirf. 

S*t  TEST  METER  t-l'tS  Vi  LOW  VOLT.  HIGH  VOLT 

H  driver  run.  Tfsr  metem  »%*•*•*•*  *.’*.*  itM 

cf  lv  p>U. 

r^l  TEST  MFTER  »*.!•. h  to  CP  0  OHIVF,  PA  COR. 
K>w£R  OUT.  lief  METER  fcdivi?*  Ju.t  Win#  paf 
•<i*  c*f  to1*. 

S*t  MV  RtStT  t**it d.  to  C*l  HAT  f .  TE5T  METER  Wfc- 
t»>t  #»w»  I**t  an  ef  RiU. 


The  final  consideration  Is 
the  availability  of  the  JPA. 

The  printed  medium  permits 
unlimited  distribution.  The 
JPAs  can  be  given  to  every 
soldier  that  needs  one  and/or 
the  JPA  can  be  packed  with 
the  equipment.  Employment 
of  either  Lhe  AO  or  AV 
medium  do  not  afford  you 
this  flexibility. 


VERIFY  activity  steps 


GROUP  STEPS  INTO  UNITS 


PRODUCE  JPA 


you  decide  that  a  JPA  is  needed, 
determine  al 1  the  steps  of  the 
procedure  that  a  novice  would  need 
to  know.  Keep  the  activities 
simple;  compound  activities  can 
lead  to  confusion.  Next,  group 
the  activity  steps  into  small 
manageable  units.  For  example, 
if  nine  steps  are  required  to 
checkout  a  radio,  group  all  nine 
into  one  activity.  Finally,  pro¬ 
duce  the  JPA  according  to  the 
media  guidelines  mentioned  earlier. 


Bibtioqsiaf 


TRADOC  PAMPHLET  350-30.  1 SD:  Phase  111.  Fort  Monroe,  Virginia: 

U.  S.  Army  Training  and  Doctrine  Command,  August  1975.  (Pp.  252-257 
contain  a  description  and  examples  of  job  performance  aids.) 


Joyce,  R.  P.,  Chen2off,  A.  P.,  Mulligan,  J.  F.,  &  Mallory,  W.  T.  Fully 
procedura 1  i  zed  job  performance  aids:  Handbook  for  JPA  developers 
1AFHRL-TR-73"1*3)  .  Wr  ight-P  atterson  Air  Force  Base,  Ohio:  U.  S. 
Air  Force  Human  Resources  Laboratory,  December  1973*  (Contains 
a  good  description  of  how  effective  JPAs  can  be  developed.) 


*1.5.2  JPA  Technical  Procedures 


Decide  on  the  appropriate 
medium  for  the  JPA.  Then  consult 
the  previous  sections  of  this 
chapter  for  the  technical  pro¬ 
cedures  which  are  appropriate. 


n 


Sections  4.1  to  4.5  gave  you  the 
human  factors  criteria  to  use  in  order 
to  develop  TEC  lessons.  This  section 
provides  some  sample  checklists  based 
on  those  criteria  which  can  be  used 
to  assess  the  quality  of  a  TEC  lesson 
at  various  stages  of  development. 

These  checklists  can  be  used  to  assess 
a  contractor's  lesson  development  as 
well  as  your  own  in-house  efforts. 
These,  or  similar  devices,  should  be 
applied  to  all  lessons  and  negative 
findings  should  be  corrected.  Al¬ 
though  the  ultimate  responsibility 
for  assessing  lesson  quality  rests 
with  the  Naval  Training  Equipment 
Center  (NTEC) ,  you  should  assist 
in  the  quality  check  by  assessing 
lesson  design  quality  at  all  review 
points  from  the  initial  draft  to 
final  approval  of  the  preproduction 
sample. 


14.6.1  Review  and  Revision  of  the 


Initial  Draft 


After  the  first  draft  of  a 
TEC  lesson  has  been  developed  (either 
in-house  or  under  contract),  you 
should  review  the  lesson  for  com¬ 
pleteness  and  accuracy.  Doctrinal 
accuracy  should  be  reviewed  by 
school  experts  ,  SMEs)  and 

completeness  of  script  according 
to  the  lesson  outline  (Kit  Design 
Approach,  if  under  contract)  by 
school  TEC  project  officers. 

You  should  use  this  review 
to  determine  what  you  want  the 
final  product  to  look  like.  Docu¬ 
ment  all  discrepancies  because 
a  failure  to  validate  may  be 
a  result  of  poor  design.  This 
record  will  help  you  decide  what 


validate  the  lesson,  Generally, 
non- reject  ion  of  poor  kit  design 
will  lead  to  validation  problems 
and  to  the  possible  acceptance 
of  a  poorly  designed  TEC  lesson. 

To  assist  you  in  assessing 
TEC  lesson  quality  at  the  initial 
draft,  two  checklists  are  pro¬ 
vided,  One,  the  "TEC  Script/ 
Manuscript  Evaluation  Instrument" 
(developed  by  the  Combat  Arms 
Training  Board  -  CATB)  ,  is  useful 
in  determining  the  completeness  of 
the  lesson  and  in  determining 
the  responsibility  for  errors. 
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REVIEW  AND  REVISION  OF  INITIAL  VR AFT 


The  second  checklist,  the  "Human 
Factors  Criteria  Checklist",  is 
based  on  the  human  factors  criteria 
given  in  Sections  ^*.1  -  lt.5.  Based 
on  these  criteria  you  can  use  this 
checklist  to  determine  if  the  design 
is  acceptable.  The  analysis  of  "no" 
answers  will  lead  to  an  improved 


All  noted  problems  should  be 
corrected  (by  the  contractor  if  it 
is  a  contractor  effort;  by  the 
school  if  it  Js  an  in-house  effort) 
Once  revisions  are  made,  you 
should  review  those  revisions  to 
insure  that  acceptable  changes 
have  been  made. 


4.6.2  Review  and  Revision  of  the 


Final  Draft 


The  final  draft  should 
incorporate  the  revisions 
and  corrections  drawn  from  in¬ 
dividual  trials,  small  group 
trials,  large  group  trials, 
and  your  own  prior  application  of 
the  checklists  and  questionnaires. 
This  review  is  your  last  chance  to 
change  the  lesson  before  production 
of  the  master  materials  (master 
tapes,  master  art,  camera-ready 
mechanicals,  etc.). 

Assess  the  quality  of  this 
draft  the  same  way  you  reviewed 
the  initial  draft,  using  the 
two  checklists  given  in  Section 
4.6.1.  In  addition,  check  to 
see  that  all  visuals  are  in  the 
correct  order  and  that  all  visuals 
match  up  with  a  corresponding  nar¬ 
ration  on  the  script  or  visual 
dummy.  All  problems  should  be 
corrected  (by  contractor  if  it  is 
a  contractor  effort;  by  the  school 
if  it  is  an  in-house  effort)  before 
preparation  of  the  master  materials. 

An  additional  consideration 
for  assessing  the  quality  of  TEC 
lessons  is  user  acceptability.  De¬ 
signing  a  lesson  that  is  not  disliked 


REVIEW  THE  FINAL  DRAFT  THE 
SAME  AS  THE  INITIAL  DRAFT 

CHECK  SEQUENCE  OF  VISUALS 

CHECK  RELATIONSHIPS  OF 
VISUALS  TO  NARRATION 
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is  half  the  battle.  The 
soldiers  you  use  for  indivdual 
trials,  small  group  trials, 
and  large  group  trials  can  also 
provide  information  relating  to 
user  acceptabi 1 i ty . 

One  means  of  obtaining  the 
information  is  to  use  a  simple 
checklist  questionnaire  similar 
to  the  one  below.  Following  up 
the  "no"  answers  should  provide 
you  with  additional  information 
for  insuring  an  effective  TEC 
lesson. 


USER  EVALUATION 


Yet  No 


1.  Was  the  lesso-.  Interesting? . 

2.  Was  the  Information  useful?  . 

3.  To  the  best  of  ycur  knowledge  was  the 

Information  accurate?  .....  . 

I.  Did  you  have  trouble  understanding  soae 

of  the  words  used  In  the  lesson? . . . 

5.  Is  this  lesson  pertinent  to  your  Army 

career? . . . 

6.  Were  the  lesson  objectives  clear?  ...  . 

7.  Was  the  lesson  well  nrganlred?.  .  .  . 

8.  Was  the  lesson  too  difficult? . .  . 

9.  Was  the  lesson  too  long’ . .  .  .  .  . 

10.  If  the  lesson  required  practical 

exercises  to  learn  the  objectives,  uera 

there  enough1  .  . . . . 

II.  Did  the  lenson  provide  enough  review 

questions? . .  .  .  . 

12.  If  the  lesson  contained  Illustrations! 

a)  Were  they  Interesting?. . .  .  .  .  . 

b)  To  the  best  of  your  knovlrJge,  were 

they  technically  correct?  . 

c)  Was  their  meaning  clear?  . 

13.  If  the  lesson  contained  an  audio  recording: 

a)  V.'as  It  paced  slow  enough?  . . 

b)  Was  the  narrator's  voice  pleasant? . 

c)  Could  vou  understand  the  narrator? . 


V  6? 
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The  Master  Kit  is  the  complete 
TEC  kit/lesson  prepared  for  mass 
production.  This  final  review  af¬ 
fords  the  opportunity  of  previewing 
exactly  what  will  be  placed  in  the 
final  product. 

Again,  use  the  checklists  given 
in  Section  4.6.1  to  assist  in  your 
review.  Remember though  ,  make  tech¬ 
nical  changes  not  preferential 
changes.  This  is  not  the  time  to 
decide  that  the  sky  is  not  blue 
enough  or  that  wind  is  bending 
the  grass  the  wrong  way. 

Examine  the  total  kit  (audio 
and  visual  simultaneously  for  AV 
lessons)  to  assure  it  is  correct 
and  complete.  Because  you  are 
viewing  35  mm  copies  of  the  final 
art,  you  may  not  be  able  to  de¬ 
tect  all  the  minor  mistakes  that 
will  cause  projection  distortions. 
Don't  worry,  because  the  NTEC  Pro¬ 
ject  Engineer  (PE)  will  review 
the  master  for  technical  quality. 

NTEC  will  also  check  to  see  that 
all  components  of  the  Master  Kit 
are  in  compliance  with  the  speci¬ 
fications  of  the  applicable  contract. 
Thus,  you  should  concentrate  on 
technical  content,  and  forward  all 
comments  to  the  NTEC  PE. 


•  REVIEW  MASTER  KIT  USING 
PREVIOUS  CHECKLISTS 

o  CHECK  FOR  COMPLETENESS 
AND  ACCURACY 


4.6.4  Review  of  the  Preproduction 
Sample 


This  is  the  last  time  you  v/i  1 1  see 
the  kit  before  mass  distribution;  once 
approved,  copies  will  be  made.  Again, 
you  should  scrutinize  the  kit  using  the 
checklists  previously  provided.  Although 
you  are  not  expected  to  assess  the  quality 
(e_.  g.,  exposure,  positive  dirt,  etc.), 
do  comment  on  all  problems  that  you  can 
detect  and  forward  your  comments  to 
NTEC  for  final  approval. 


9  REVIEW  PREPRODUCTION  SAMPLE 
FOR  COMPLETENESS  AND  ACCURACY 
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TEC  VALIDATION 
•  IN-HOUSE  EVALUATION 

-  PPE-  AND  POSTTEST  DEVELOPMENT 

-  INDIVIDUAL  TRIAL 

-  SMALL  GROUP  TRIAL 

-  EFFECTIVENESS  TESTING 
SCORING  AND  LESSON  VALIDATION 

»  CONTRACT  LESSON  EVALUATION 


This  chapter  has  two  uses.  First, 
it  is  designed  to  aid  you  in  evaluat¬ 
ing  TEC  lessons  developed  in-house. 
Second,  the  chapter  is  to  be  used 
in  conjunction  with  TEC  contract 
specifications  when  monitoring  the 
evaluation  of  lessons  developed 
under  contract. 

Section  5.1  discusses  the  TEC 
lesson  evaluation  process  and  pro¬ 
vides  needed  background  for  under¬ 
standing  the  finer  points  of  that 
process  while  Sections  5.1.1  through 
5.1.5  define  the  five  phases  in  the 
TEC  lesson  evaluation  process,  viz., 
pre-  and  posttest  development, 
individual  trials,  small  group  trials 
(optional),  evaluation  test,  and  the 
validation  decision.  Section  5.? 
provides  a  description  of  your  role 
in  monitoring  TEC  lessons  developed 
under  contract  and  presents  inform¬ 
ation  relative  to  minimizing  errors 
during  evaluation  testing. 


The  TEC  lesson  validation  process 
is  a  training  effectiveness  evaluation. 
The  iterative  process  of  lesson  develop 
nient  and  the  subsequent  testing  of 
instruction  are  creating,  through  trial 
and  revision,  training  effective  TEC 
lessons  for  job  relevant  tasks. 

The  purpose  of  TEC  lesson  evalu¬ 
ation  is  to  demonstrate  the  training 
effectiveness  of  a  given  TEC  lesson  at 
each  stage  of  development.  The  weak¬ 
nesses  are  identified  that  can  be 
strengthened  by  modifying  any  combin¬ 
ation  of  the  lesson's  content,  visuals, 
or  sound  track.  Once  modified,  the 
lesson  is  evaluated  again.  In  a  sense, 
the  process  resembles  the  method  of 
adjusting  artillery  fire  by  the 
bracketing  process.  Fire,  ana  adjust; 
fire,  and  adjust.  The  process  is 
repeated  until  the  target  is  hit  and 
then  there  is  fire  for  effect.  A  TEC 
lesson  is  tried  on  members  of  the 
target  population  until  it  works. 

That  is,  until  the  trainees  achieve 
the  learning  objectives.  Then  the 
lesson  is  ready  to  be  packaged  and 
distributed  for  "Training  For  Effect." 

The  training  effectiveness  evalu¬ 
ation,  (shown  below)  if  properly 
conducted,  will  ensure  that  the 
instruction  teaches,  ,  a  majority 
of  the  target  audience  will  achieve 
established  learning  objectives  at  a 
specified  criterion  level. 


THE  TRAINING  EFFECTIVENESS  EVALUATION  PROCESS 


A  PROVEN  EFFECT  I V F 
TEC  LESSON 


OPPORTUNITY  FOR  ERROR. 
RESULTING  FROM  IN¬ 
APPROPRIATE  INSTRUCTION 
REDUCED  THRU  APPLICA¬ 
TION  Or  THE  TEC  LESSON. 
EVALUATION  PROCESS. 


will  also  be  able  to  perform  the 
required  soldiers'  tasks  at  a 
criterion  1  eve  1 . 

The  training  objectives  for  a 
TEC  lesson  are  usually  provided  to 
the  TEC  Manager  by  other  elements  of 
the  TRADOC  school.  (If  training 
objectives  are  not  provided,  you  have 
to  develop  them.)  These  objectives 
are  derived  directly  from  complete 
task  analyses  of  soldiers'  jobs. 
Nevertheless,  you  are  responsible 
for  verifying  the  validity  of  the 
training  objectives.  At  the  mini¬ 
mum,  your  SMEs  should  carefully 
assess  the  content  validity  of  all 
training  objectives.  Content 
validity  can  be  established  by 
systematically  checking  that 
objectives  have  been  derived  from 
an  analysis  of  what  the  soldier 
must  know  and/or  do  in  order  to 
perform  the  task  to  be  taught  in 
the  TEC  lesson. 

The  training  effectiveness 
of  a  lesson  is  measured  in  terms 
of  the  pre-  and  posttest  accompany¬ 
ing  it.  The  difference  in  post¬ 
test  scores  over  pretest  scores  is 
a  direct  measure  of  how  v/e  1 1  the 
lesson  trains.  Pre-  and  posttests 
have  to  be  validated  to  insure  they 
are  measuring  what  is  intended  to 
be  measured.  This  will  lead  to 
reduced  error  in  testing  and  lesson 
development  and  to  increased  effect¬ 
iveness  of  TEC  lessons.  Methods  for 
validation  of  the  pre-  and  post  test 
are  presented  in  the  "Developing  a 
Valid  Test"  section . 


THE  SUCCESS  OF  THE  INSTRUCT¬ 
IONAL  DEVELOPMENT  PROCESS  IS 
BASED  ON  TWO  ASSUMPTIONS: 

•  THE  TRAINING  OBJECTIVES 

ARE  VALID 

•  THE  CRITERION  REFERENCED 

TEST  ITEMS  USED  IN  THE 
PRE-  AND  POSTTESTS  IN  THE 
EFFECTIVENESS  EVALUATION 
ARE  VALID 


THE  FIVE  PHASES  OF  THE  TEC 
LESSON  EVALUATION  PROCESS: 

•  PRE-  AND  POSTTEST  DEVELOP¬ 
MENT  PHASE 

9  INDIVIDUAL  TRIAL  PHASE 

c  SMALL  GROUP  TRIAL  PHASE 
(OPTIONAL) 

a  EFFECTIVENESS  TESTING  PHASE 
(LAKGi  GROUP  PHASE) 

t  VALIDATION  DECISION-MAKING 
PHASE 
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EVALUATE  TRAINING  EFFECTIVENESS 
WITH 


0  PRETEST 
0  POSTTEST 
0  PERFORMANCE  TEST 


Your  respons ib i I i ty  as  a Iht  lesson 
evaluator  begins  in  the  stage  where 
training  objectives  are  translated  into 
performance  to  be  measured  by  criterion- 
referenced  test  items.  For  example, 
the  training  objective  -  field  strip 
an  M16A1  rifle  in  total  darkness  within- 
5  minutes  -  is  measured  by  criterion- 
referenced^and  performance  test  items 
that  record  the  GO  -  NO  GO  of  the 
field  stripping  and  the  time  required 
to  per  form  it. 


In  the  TFC  lesson  development  proci 
the  criterion-referenced  test  items  are 
developed  prior  to  the  design  of  the 
lesson  itself.  These  test  items  arc- 
incorporated  into  the  pre-  and  post¬ 
tests.  Without  a  valid  test  to  measure 
training  effectiveness  of  a  lesson,  you 
cannot  know  when  you  have  a  valid  lesson. 


Although  the  pro-  and  the  posttest 
are  usually  the  same  test,  you  may  pre¬ 
fer  to  have  the  posttest  differ  from 
t ho  pretest  in  some  situations.  You 
must  be  absolutely  sure,  however,  that 
the  test  items  in  the  two  tests  measure 
the  same  training  objectives.  Pre- 
ond  posttests  may  be  one  or  a  combination 
of  two  types  of  tests:  a  paper-and- 
penci 1  test  or  a  performance  test.  If 
you  do  not  incorporate  a  performance 
component  into  the  pro-  and  the  post¬ 
tests,  you  should  include  a  performance 
t c 5 1  in  addition  to  the  pre-  and  post¬ 
tests  for  the  purpose  of  evaluating 
training  effectiveness. 


Vatiditij  and  ReJUa b VLiXj.  Test 
construction,  like  lesson  development, 
is  an  iterative  process  of  trial  and 
error.  It  begins  with  the  selection  of 
a  large  pool  of  test  items  -  either 
performance  items  or  written  items  - 
which  are  related  to  the  performance 
objectives.  Next,  you  must  examine, 


construct  the  test  and  invalid  ones 
are  d  i  scal  ded . 


Validity  and  reliability  are 
the  two  elements  which  describe 
the  utility  and  accuracy  of  a  test. 
Validity  is  the  most  important  aspect 
of  any  type  of  test.  The  validity 
of  a  test  is  defined  as  the  degree 
to  which  a  test  measures  the  perform¬ 
ance  it  was  designed  to  measure. 

The  reliability  of  a  test  is 
defined  as  the  consistency  of  the 
measure.  That  means  only  that  the 
test,  no  matter  what  it  is  measuring, 
will  produce  the  same  value  (score) 
or  one  very  close,  every  time  a 
person  takes  the  test.  To  evaluate 
TEC  training  effectiveness  of  the 
lesson,  the  test  must  be  dependable. 
But,  that  is  not  enough;  it  may 
measure  consistently,  and  still  not 
be  valid,  i  .ew  ,  measure  what  is 
intended  to  measure.  Tests  used 
for  TEC  lessons  must  be  both 
reliable  and  valid.  They  must 
consistently  measure  the  effective¬ 
ness  of  the  lesson  with  respect  to 
the  soldiers'  real  performance 
requ i rements . 


Developing  a  Vatid  Test.  One 
can  only  estimate  the  validity  of 
a  test.  But,  there  are  known 
techniques  to  use  in  developing  a 
valid  test . 


To  determine  item  content 
validity  you  must  examine  the 
initial  pool  of  test  items  on  an 
item  by  item  basis  to  see  if  each 


TESTS  MUST  BE 

•  VALID 

•  RELIABLE 


' 
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VALID  TESTS  COMPRISE 

•  ITEM  CONTENT  VALIDATION 

•  EMPIRICAL  ITEM  VALIDATION 
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appears  to  measure  what  it  was  intended 
to  measure.  The  examination  should 
involve  two  steps: 

©  Making  systematic  comparisons  be¬ 
tween  tiaining  objectives  and  the 
test  items  designed  to  measure  those 
objectives  (For  greater  detail  See 
Swezey  and  Pearlstein,  1 975)  - 

•  Having  SMEs  review  the  objectives 
plus  the  test  items  developed 
to  measure  them. 

The  SME  review  should  result  in  necessary 
revisions  of  the  test  items  with  respect 
to  required  tasks,  applicable  conditions, 
and  scoring  standards.  The  review  should 
also  examine  administrative  feasibility 
and  define  the  standardized  testing  con¬ 
ditions.  This  process  should  produce 
conten t -va 1 i d  test  items  which  arc 
usable  for  the  test. 

Test  items  should  then  be  empir¬ 
ically  validated  through  testing  the 
performance  of  two  qroups  of  subjects. 

One  group  should  be  experts  (Masters) 
in  the  performance  requirement  the 
lesson  is  to  support.  The  other  group 
should  be  novices  ( Mon - r asters) . 

Candidate  Masters  and  Non-masters  should 
be  identified  by  school  personnel.  The 
candidates  should  be  identified  either 
by  skill  levels,  by  rank,  or  preferably 
by  sound  judgments  of  individual  job 
performance  capability.  for  this 
analysis  to  be  effective,  you  must  be 
sure  that  the  Masters  have  truly  mastered 
the  required  skills.  Select  your  sub¬ 
jects  using  the  sampling  procedures 
discussed  in  Section  5.1  .k.  After 
selection,  administer  the  criterion- 
referenced  test  items  to  both  groups. 
Remember,  the  lesson  itself  is  not 
involved  in  the  test  validation  process; 
your  concern  is  only  with  the  test 
items  and  the  performance  requirements. 
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After  you  have  administered 
the  test  and  collected  the  data, 
submit  the  data  to  analysis  using 
the  Phi  coefficient  (shown  below). 
The  Phi  coefficient  is  used  to 
identify  those  items  which  are 
valid  measures  of  job  proficiency. 
Test  items  which  discriminate 
between  Masters  and  Non-masters 
are  considered  to  be  valid  (j_.e^  , 
valid  items  arc  those  which  most 
Masters  pass  and  most  Non-masters 
fail).  Valid  items  will  then  be 
included  in  the  test.  Items  that  do 
not  discriminate  consistently  are 
invalid  and  should  be  eliminated 
from  the  test.  The  test  may  have 
to  be  revised  and  examined  several 
times  before  it  can  be  considered 
va I  id. 


USE  OF  THE  PHI  COEFFICIENT  TO  ESTABLISH 


EMPIRICAL  ITEM  VALIDATION* 


!.  «5  i  s  best  used  when  items  arc  scored  pass-fail,  go  -  no  go, 

acceptable-unacceptable,  or  f-0,  and  when  there  ate  about 
the  same  number  of  persons  in  the  "Masters"  and  "Non-Masters" 
groups. 

2.  To  compute  6  for  an  item,  determine: 

A.  How  many  "Masters"  passed  the  item 

B.  How  many  "Masters"  failed  the  item 

C.  How  many  "Non-Masters"  passed  the  item 

D.  How  many  "Non-Masters"  failed  the  item 

3-  Fill  in  the  information  determined  above  in  a  table  such 
as  this  one  (and  make  the  additions  indicated  in  the 
right  and  bottom  margins  of  the  table): 

I  tem 


Fail 

Pass 

"Mas  ters" 

B 

A 

A+B 

"Non-Masters" 

D 

C 

C+D 

B+D 

A+C 

A.  Calculate  ^  by  substituting  the  values  from  the  table  into 

this  formula: 

j  AD-BC 


//( A+B)  (C+D)  (A+C)  (BT[T) 

5.  If  the  value  of  6  for  an  item  is  less  than  +.30,  consider 

it  a  "Warning  rlag"  for  that  item:  Pay  careful  attention 
to  the  item  because  it  may  be  a  poor  one  -  it  is  often 
better  to  throw  out  that  item,  develop  a  new  one  and  try 
it  out. 


'Swezcy  and  Pearl  stein,  1975- 
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PRE-  AMD  POSTUST  VEt/ELOPMENT 


Remember,  if  any  test  item  is 
determined  to  be  invalid,  you  must 
reject  it  or  redesign  it  and  submit  it 
to  the  same  test  development  process. 
Repeat  the  procedure  using  different 
students  until  you  have  an  empirically 
valid  test.  Once  you  have  determined 
that  a  test  is  valid,  you  should  examine 
its  reliability. 


CAtabtoilung  a  Reliab?Q  Tut.  There 
are  many  methods  which  may  be  used  to 
estimate  a  test's  reliability.  The  split- 
half  method  (given  below)  divides  a  test 
into  two  half-length  tests.  These  half 
tests  are  scored,  correlated,  and  used 
in  an  additional  calculation  to  estimate 
the  reliability  of  the  test. 


The  test  items  should  be  split  so 
that  one  or  more  items  related  to  each 
training  objective  falls  into  each  half 
of  the  test.  This  wi 1  1  make  the  two 
halves  more  rationally  equivalent.  If 
there  are  not  at  least  two  items  for  a 
given  training  objective,  try  to  match 
the  item  by  placing  an  item  for  a  related 
training  objective  in  the  second  half¬ 
test.  Now,  number  these  items  in  one 
test  v/ith  even  integers  and  those  in 
the  other  with  odd  integers,  and  then 
combine  all  of  the  items  into  one 
overall  test.  Administer  the  test  as 
though  it  had  never  been  split.  Score 
the  test  to  produce  two  separate  scores  - 
one  for  the  odd  numbered  items  and  one 
for  the  even  numbered  items.  Keep  the 
two  scores  for  each  student's  test 
together;  they  are  the  "matched  pair" 
scores  you  will  correlate. 


To  correlate  the  scores,  you 
will  have  to  compute  r_,  a  corre¬ 
lation  coefficient,  by  the  method 
given  below. 


CORRELATING 

TEST  SCORES  -  AN 

EXAMPLE 

S  t  uden t 

Scores  on 

Odd  1  terns 
(X) 

Scores  on 

Even  1  terns 
(Y) 

X2 

Y2 

XY 

1 

8 

3 

2 

2 

1 

3 

8 

6 

<t 

5 

3 

5 

15 

1ft 

6 

1  1 

12 

7 

13 

9 

8 

6 

ft 

9 

ft 

't 

0 

6 

5 

HX-78 


£  Y=6l 


EX?=760  £Y2=533  £XY=6l 8 


Finally,  to  arrive  at  your  goal  of 
a  reliability  estimate,  you  will  have 
to  compute  r  by  the  method  given  below. 


COMPUTING  r 


Where : 


the  estimated  reliability  of  t lie 
full  1 ength  test 

the  correlation  coefficient  between 
the  even  scores  and  the  odd  scores 


EXAMPLE: 


Using  r  =  0.91 


r  =  2(0.91) 
1+(0.9I) 


(1 -82)  =  0.953 

TTT9TT 


You  should  be  aware  that  the  value 
of  £  can  range  from  -  1.00  through  zero 
to  +1.00.  If  the  value  of  £  i s  less 
than  +0.60  or  is  negative,  the  test  has 
questionable  reliability.  Therefore, 
regard  values  between  +0.60  and  -1.00 
as  a  warning  flag  and  consider  the 
alternatives  given  below. 


QUESTIONABLE  RELIABILITY  ALTERNATIVES: 


•  CHECK  ALL  FIGURES  FOR  ERRORS. 

•  CHECK  EACH  HALF-LENGTH  TEST  FOR  EQUIVALENT  ITEMS,  i.e., 
EACH  ITEM  IN  THE  EVEN  PART  OF  THE  REST  HAS  TO  HAVE  AN 
"EQUIVALENT"  ITEM  IN  THE  ODD  PART  OF  THE  TEST. 

9  CHECK  THE  VALIDATION  PROCEDURE  FOR  BOTH  ITEM  CONTENT 
VALIDATION  AND  EMPIRICAL  ITEM  VALIDATION. 

0  ADD  EQUIVALENT  ITEMS  THAT  CORRESPOND  TO  THE  LESSON 
OBJECTIVES  TO  EACH  HALF-LENGTH  TEST.  ADDING  ITEMS 
OFTEN  INCREASES  THE  RELIABILITY  OF  A  TEST. 

9  IF  NO  WEAKNESSES  CAN  BE  DETECTED  AND  ADDITIONAL  ITEMS 
DO  NOT  HELP,  YOU  WILL  HAVE  TO  DEVELOP  NEW  ITEMS  AND 
MODIFY  THE  TEST  UNTIL  IT  IS  BOTH  VALID  AND  RELIABLE. 
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imVWUAL  TRIAD  PHASE 


5.1.2  Individual  Tria]^  Phase 


You  need  to  prepare  for 
and  conduct  individual  trials 
with  great  care.  The  results 
of  tnese  trials  will  point  out 
weaknesses  in  your  lesson  for 
revision  and  help  you  decide 
when  to  proceed  to  full  valid¬ 
ation  trials. 

Individual  trials  are  cor  - 
ducted  during  the  development  of 
a  master  TEC  lesson,  _i_.£.  ,  the 
storyboard  or  a  sound/slide 
format.  The  trials  must  test 
all  of  the  lesson  materials, 
the  tests,  the  instructional 
materials,  models,  etc.  Every¬ 
thing  required  to  implement 
the  lesson  must  be  evaluated. 

In  preparing  for  the  individual 
trial,  you  must  consider  the 
eight  requirements  given  below. 


Ail  INDIVIDUAL  TRIAL  IS 

•  CONDUCTED  BY  iRYING  INSTRUCT¬ 

IONAL  MATERIALS  INDIVIDUALLY 
01  3  TO  5  STUDENTS  REPRESENT¬ 
ATIVE  OF  THE  TARGET  POPULATION 

•  CONDUCTED  FOR  THE  PURPOSE  OF 

IDENTIFYING  THOSE  AREAS  WITHIN 
THE  LESSON  SUBJECT  KIT  WHICH 
REQUIRE  REVISION  TO  INSURE 
INSTRUCTIONAL  EFFECTIVENESS. 


PREPARING  FOR  THE  INDIVIDUAL  TRIAL: 

•  IDENTIFY  AMD  PROVIDE  THE  EQUIPMENT  REQUIRED  TO  CONDUCT  THE  TRIALS,  i_.e., 

35  MM  PROJECTORS,  AUDIO  EQUIPMENT,  MATERIALS,  AND  ANY  MILITARY  EQUIPMENT 
NECESSARY  FOR  PERFORMANCE  TESTING. 

•  INSURE  THAT  ENOUGH  COPIES  OF  ALL  MATERIALS  ARE  AVAILABLE. 

•  INSURE  THAT  ALL  NECESSARY  PRETEST  INSTRUCTIONS  (i.e.,  TIME  LIMITS,  ETC.) 

ARE  IDENTIFIED  AND  USED  FOR  EACH  TRIAL. 

•  TRAIN  THE  EVALUATORS  IN  TESTING  (IF  NECESSARY). 

•  PROVIDE  GUIDANCE  FOR  THE  FVAI  UATOR  ON  ANSWERING  STUDENT'S  QUESTIONS. 

«  PROVIDE  ANY  OTHER  MATERIAL  NECESSARY  FOR  THE  TRIAL,  i.e.,  ANSIIFR  SHEETS, 
NOTE  PADS,  AND  REFERENCE  DOCUMENTS. 

•  INSURE  THAT  EACH  PARTICIPANT  BELONGS  TO  THE  TARGET  AUDIENCE. 

•  LR0VI0E  PARTICIPANT  INTERVIEW  FORMATS.  (IIS.  A  FORM  SIMILAR  TO  THE 

USER  QUESTIONNAIRE  IN  SECTION  4.5  OF  CHAPTER  4.) 
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INDIVIDUAL  TRIAL  OPTIONS 

•  PROCEED  TO  LARGE  GROUP  TRIALS 

•  MODIFY  OR  REVISE  LESSON  AND 

THEN  PROCEED  TO  LARGE  GROUP 
TRIAL 

•  REVISE  LESSON  AND  REPEAT 

INDIVIDUAL  TRIAL  OR  CONDUCT 
A  SMALL  GROUP  TRIAL 


Been use  the  individual  trial 
is  feedback  to  the  developmental 
process,  the  writer  or  designer  of 
the  kit  must  participate.  The 
designer  will  then  know  what  revis¬ 
ions,  based  on  problems  identified 
in  tfie  trials  are  needed. 

Immediately  prior  to  the  indi¬ 
vidual  trials,  transport  all  test 
materials  and  equipment  to  the  test 
location.  Be  sure  you  are  familiar 
with  all  of  the  test  materials  and 
equipment.  Once  at  the  test  site, 
set  up  and  check  the  materials  and 
equipment  and  conduct  the  individ¬ 
ual  trials. 

Feedback  from  the  individual 
trials  will  tell  you  what  to  do 
next.  First,  if  the  trials  are 
completely  successful,  no 

instructional  errors  are  noted, 
the  trainees  encountered  no  pro¬ 
cedural  problems,  and  the  trainees 
passed  the  posttest,  you  may  pro¬ 
ceed  to  the  large  group  trial. 
Second,  if  you  identify  problems 
within  the  lesson  itself,  or  wi  th 
the  way  the  lesson  is  intended 
to  be  used,  you  must  revise  or 
modify  the  lesson.  Then,  proceed 
to  the  large  group  trial  if  the 
lesson  can  be  easily  corrected. 
Finally,  if  you  identify  problems 
which  require  major  revisions, 
you  may  want  to  repeat  the  indi¬ 
vidual  trials,  or  conduct  a 
sujII  group  trial,  after  revisions 
are  marie. 


B t bfoog 'id pit ij  jfo/i  5. 1.2. 

TRADOC  PAMPHLET  350-30.  I  SO  Phase  111.  Fort  Monroe,  Virginia:  U.  S. 
Army  Training  and  Doctrine  Command,  August  1975-  ( P p .  298-303 

discuss  the  procedures  to  follow  in  order  to  conduct  individual 
trials.) 
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5.1.3 _ Sma 1 1  Group  T r i a J _ P base 


Small  group  trials  can  be 
conducted  after  individual  trials, 
If  no  problems  were  identified  in 
the  final  individual  trials, 
you  may  elect  to  skip  these  and 
move  immediately  into  the  evalu¬ 
ation  testing  phase. 


°reparations  for  conducting 
the  snail  group  trial  are  identi¬ 
cal  to  those  involved  in  the 
individual  trials.  But,  you  wi I  I 
need  more  materials  to  handle 
more  trainees. 


The  difference  between  the 
individual  trial  and  the  small 
group  trial  is  solely  the  number 
of  trainees  using  the  lesson  and 
the  equipment.  Otherwise,  the 
small  group  trial  is  identical 
to  the  individual  trial  with 
similar  purposes  and  options 
based  on  resu 1 ts . 


A  SMALL  GROUP  TRIAL  IS 


•  CONDUCTED  BY  SIMULTANEOUSLY 
TRYING  INSTRUCTIONAL  MATERIALS 
ON  6  TO  10  STUDENTS  WHO  ARE 
REPRESENTATIVE  OF  THE  TARGET 
POPULATION  BUT,  NOT  INCLUDED 
IN  THE  INDIVIDUAL  TRIAL. 


CONDUCTED  FOR  THE  PURPOSE  OF 
IDENTIFYING  THOSE  AREAS  WITHIN 
THE  LESSON  SUBJECT  KIT  WHICH 
REQUIRE  REVISION  TO  INSURE 
INSTRUCTIONAL  EFFECTIVENESS. 


SMALL  GROUP  TRIAL  OPTIONS 
•  PROCEED  TO  LARGE  GROUP  TRIAL 


•  MODIFY  OR  REVISE  LESSON  AND  THEM | 
PROCEED  TO  LARGE  GROUP 


•  REVISE  LESSON  AND  RETURN  TO 
INDIVIDUAL  TRIALS 


RETURNING  THE  KIT 


IF  EITHER  THE  INDIVIDUAL  OR  THE  SMALL  GROUP  TRIAL  DISCLOSES  PROBLEM 
AREAS  WITHIN  THE  TEC  LESSON  KIT,  RETURN  IT  TO  THE  URITER/DESIGNER 
FOR  REVISION.  BE  SURE  TO  INCLUDE  APPROPRIATE  PROBLEM  IDENTIFYING 
COMMENTS  LIKE:  "THE  ILLUSTRATIONS  IN  FRAMES  5,  7,  and  9  OF  LESSON 

"A"  ARE  "BLURRED"  OR  "THE  ANSWER  KEY  IS  WRONG  "  OR  "THE  I  ESSON 
DOES  NOT  TEACH  OBJECTIVE  NUMBER 
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EFFECTIVENESS  TESTING  PHASE 
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TRADOC  PAMPHLET  350-30.  1  SD  Phase  I  M_.  Fort  Monroe,  Virginia:  U.  S. 

Army  Training  and  Doctrine  Command,  August  19/5-  ( P  p .  30^-31 ? 
provide  inforr.  jtion  for  determining  revision  requirement  and 
making  revisions.) 


5-l.*t  Effectiveness  Testing  Phase 


The  effectiveness  testing 
phase  is  the  most  important  aspect 
oi  development  of  tr. lining  effective 
TEC  lessons.  In  this  phase  you 
can  determine  whether  the  lesson 
you  have  developed  (or  monitored) 
is  truly  effective  with  the  soldiers 
for  whom  it  was  designed.  You 
will  know  after  conducting  this 
phase  that  the  lesson  wi I  I  train 
most  of  the  target  soldiers  in 
the  required  skills  to  <i  given 
level  of  proficiency.  You  and  the 
School  will  have  set  the  level 
of  proficiency  (hy  defining  the 
standards  for  GOs  on  each  train¬ 
ing  objective)  and  the  percentage 
of  soldiers  who  must  achieve  those 
standards  based  on  the  importance 
of  the  training  objective.  When 
the  lesson  lias  been  demonstrated 
to  be  effective  to  the  levels  you 
have  set,  you  can  he  confident 
that  the  lesson  wi 1 1  also  be 
effective  in  the  field.  Of  course, 
the  demonstration  of  training 
effectiveness  may  require,  revision 
and  retesting  until  the  criterion 
level  of  effectiveness  is  achieved. 

That  is  th  iterative  nature  of 
lesson  development  and  evaluation. 


3-’S 


Because  this  phase  is  so 
important  to  effective  lesson 
development,  it  must  be  conducted 
extremely  carefully  and  in 
accordance  with  these  guidelines. 
Poor  development  and  evalu¬ 
ation  costs  time  and  money  and 
results  in  ineffective  training. 
Proper  development  and  evaluation 
results  in  better  trained,  more 
effective  and  more  satisfied 
soldiers.  Remember,  your  job 
is  to  ensure  proper  conduct 
of  the  effectiveness  testing 
and  lesson  evaluation. 

The  overall  effective¬ 
ness  of  the  testing  sequence  is 
shown  below.  The  steps  are 
addressed  in  the  following 
paragraphs  and  in  Section  5.2. 


THE  EVALUATION  TESTING 
SEQUENCE 


DETERMINE  THE  TESTING  LOCATIO 


5 


P 


SELECT  TARGET  AUDIENCE  SAMPLE 


I 


ADMINISTER  PRETEST 


rJ 


1 


| ADMINISTER  THE  LESSON 
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important  to  the  proper 
validation  of  a  TEC  lesson. 
If  the  lesson  requires  use 
of  the  LAW  (Light  Antitank 
Weapon)  and  no  LAV/  can  be 
made  available  at  the  chosen 
location,  that  location  is 
no  good.  You  need  to  con¬ 
sider  other,  just  as  obvi¬ 
ous,  points. 


CONSIDERATIONS  FOR  SELECTING  TEC  LESSON  VALIDATION  LOCATIONS: 


•  IS  THE  TASK  BEING  TRAINED  PERFORMED  THERE? 

•  IS  THERE  A  LARGE  ENOUGH  TARGET  AUDIENCE  AVAILABLE  FROM  WHICH 

TO  DRAW  A  SAMPLE? 

•  CAN  THE  NECESSARY  COOPERATION  BE  SMOOTHLY  ATTAINED? 

•  CAN  THE  NECESSARY  FACILITIES  BE  MADE  AVAILABLE? 

•  CAN  THE  NECESSARY  ADMINISTRATIVE  SUPPORT  BE  MADE  AVA I  LABI  E? 


Having  selected  the  location, 
you  can  now  proceed  with  the 
eva  1 ua t ion . 


V&te'uncnxng  the  Tan gcX 
Audience  and  PimcoK}  A  SampCe. 
The  target  audience  for  a  given 
lesson  consists  of  the  entire 
population  of  soldiers  who 
must  be  trained.  This  means 
every  person  in  the  MOS  for 
which  the  lesson  was  designed. 
Or,  it  means  every  soldier  who 
can  benefit  from  the  lesson 
through:  1)  upgrading  his/ 

her  MOS;  2)  ret  raining  into 
the  MOS;  3)  reviewing,  prac¬ 
ticing,  and/or  maintaining 
MOS  skills. 


IDENTIFYING  THE  TARGET  AUDIENCE 

•  IDENTIFY  THE  MOS  FOR  WHICH  THIS  TEC 

LESSON  IS  BEING  PREPARED. 

t  IDENTIFY  Tilt  NUMBERS  OF  PEOPLE 
ASSIGNED  THE  MOS. 

•  IDENTIFY  SKILLS  THAT  CAN  BE  TRAINED 

REVIEWED,  PRACTICED,  OR  MAINTAINED 
BY  USING  THE  LESSON. 

•  IDENTIFY  REQUISITE  SKILLS. 


•  THE  SUB-POPULATION  SAMPLE  MUST  NOT 
DIFFER  FROM  THE  TARGET  POPULATION  IN 
ANY  WAY  THAT  WOULD  AFFECT  THE  LESSON 
EVALUATION. 


Drawing  a  represent¬ 
ative  sample  from  the  target 
population  is  the  next  step. 

The  sample  must  be  represent¬ 
ative  of  the  population  - 
not  confined  to  some  peculiar 
subgroup,  such  as  highly 
trained  personnel,  or  espec¬ 
ially  selected  personnel  - 
so  that  the  results  of  the 
lesson  testing  can  be  expected 
to  apply  to  the  whole  popu¬ 
lation.  The  usual  scientific 
way  to  assure  a  representative 
sample  is  to  draw  randomly 
from  the  total  population 
until  a  sufficiently  large 
group  is  obtained  to  provide 
a  reliable  sample  of  the 
population.  This  is  imprac¬ 
tical  for  TEC  lesson  testing 
because  the  population  is 
widely  dispersed  and  indivi¬ 
duals  in  the  target  DOS  cannot 
be  called  back  from  U.  S. 
Army-Europe  (USAREUP.)  ,  Alaska, 
or  Korea,  just  to  participate 
in  lesson  evaluation.  There¬ 
fore,  we  settle  for  a  sample 
drawn  from  the  sub-popul  a t i on 
available  at  the  testing 
installation  -  assuming  there 
are  no  special  qualifiers 
about  the  troops  at  this  instal 
lotion,  such  as  special  sclecti 
on  GT  score,  that  makes  this 
group  non-representat i vc  of 
the  population.  If  the  sub¬ 
population  is  suspected  of 
being  very  diffeient  from  the 
population  -  better  or  worse  - 
in  ways  that  would  affect  the 
TEC  lesson  evaluation,  then 
find  another  sub-population. 

After  identifying  the  sub 
population  to  be  sampled,  then 
are  several  ways  to  draw  the 
actual  sample  of  30  or  more 
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in  lesson  training.  The 
most  scientific  would  be 
to  throw  the  names  (or 
SSANs)  into  a  hat  or 
barrel ,  stir  them  up 
thoroughly,  and  draw 
one  name/SSAN  at  a  time 
until  you  had  enough 
individuals  for  the 
sample.  This  would  as¬ 
sure  a  truly  random 
sample.  However,  this 
is  also  somewhat  imprac¬ 
tical;  and  a  simpler 
method  can  be  used  which 
provides  nearly  as  good 
resul ts . 

The  simple  method 
is  to  obtain  an  ordered 
list  of  SSANs  of  the 
available  individuals 
across  units  and  to  sam¬ 
ple  systematically  from 
the  list.  That  is,  if 
there  are  500  troops  in 
the  desired  MOS  at  an 
installation  and  you 
want  a  sample  of  35 
troops  for  testing,  get 
the  list  of  the  SSANs 
of  t he  500  troops,  and 
select  every  Hlth*  one 
on  the  list  for  your 
sample.  Thi  s  wi  1  1  give 
you  35  names  out  of  the 
500.  Since  some  of  these 
people  will  not  be  avail¬ 
able  for  testing,  it  is 
wise  to  take  every  15th 
name  as  an  alternate  for 
the  preceding  name  on 
the  list  and  use  that 
individual  only  when  the 
original  pick  is  not 
available.  Although 
this  process  is  not 


-The  number  I  (t  comes  from  dividing  the  sub-population  size  (500)  by  the 
desired  sample  size  (35).  The  number  counted  to  the  person  to  be  picked 
thus  varies  with  the  sub-population  size  and  sample  size.. 
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strictly  a  random  one,  it 
will  yield  an  essentially 
random  sample  of  the  sub¬ 
population  because  there 
are  normally  no  systematic 
biases  in  cither  SSAN  assign¬ 
ments  or  list  aggregation. 

It  can  be  shown  that  SSAN 
assignment  is  essentially 
a  random  process,  and  that 
systematically  sampling  from 
SSANs  provides  essentially 
a  random  sample. 

In  general,  the  rules, 
given  below  must  be  observed. 


RULES  FOR  SAMPLE  SELECT  10, ‘ i 


8  STUDENTS  FOR  THE  EVALUATION  TEST  MUST  BE  RANDOMLY  SELECTED  FROM 

THE  STUDENTS  AVAILABLE.  (THIS  RULE  IS  MODIFIED  BY  THE  FOLLOWING  RULES.) 

e  STUDENTS  USED  FOR  THE  EVALUATION  SAMPLE  MUST  NOT  HAVE  BEEN  USED  FOR 
DEVELOPMENTAL  TESTING  COVERING  THE  OBJECTIVES  BEING  EXAMINED. 

•  4 

•  STUDENTS  MUST  HAVE  MASTERED  PREREQUISITES  AND  HAVE  PASSED  POSTTESTS 
OF  PREREQUISITE  TEC  LESSONS,  ADMINISTERED  BY  THE  SERVICE  SCHOOL,  III 
ORDER  TO  BE  USED  AS  SUBJECTS  FOR  VALIDATION  TESTS  FOR  MATERIALS  WHICH 
ARE  DESIGNED  TO  BUILD  UPON  PREVIOUS  INSTRUCTION. 


•  STUDENTS  WHO  PASS  THE  PRETEST  SHALL  NOT  BE  USED  AS  PART  OF  TIIF.  VALIDATION 

SAMPLE. 

•  IF  TESTING  IS  CONDUCTED  USING  A  FIXED  SAMPLE  SIZE,  THAT  SAMPLE  SHOULD 

INCLUDE  AT  LEAST  30  STUDENTS. 


In  some  cases,  you  may 
have  to  make  sure  the  lesson 
is  equally  effective  for  dif¬ 
ferent  subgroups  in  the  popula¬ 
tion.  For  example,  if  the 
lesson  is  to  be  used  for  both 
male  and  female  soldiers,  and 
if  you  think  there  may  be  dif¬ 
ferent  training  effectiveness 
for  the  two  groups,  you  will 
have  to  test  it  on  sufficient 
numbers  of  both  groups  to  demon¬ 
strate  its  effectiveness  for 
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for  about  30  -  35  persons 
to  be  tested  In  each  group 
and  for  stratified  sampling 
development. 

For  this  type  of  test¬ 
ing  situation,  you  would 
break  your  500  troops  into 
the  two  subgroups:  let's 
say  it  breaks  into  350 
males  and  150  females. 

To  select  your  two  sam¬ 
ples,  each  of  35  troops, 
yo j  would  then  take  every 
1 0th  male  on  the  list  for 
the  male  sample;  and  every 
b th  female  on  the  list 
for  the  female  sample. 
Similar  sampling  might  be 
necessary  by  Branch  or  by 
M0S  when  testing  lessons 
to  be  equally  effective 
across  Branches  or  across 
MOSs.  Such  multiple  group 
testing  would  only  be 
necessary  when  you  or  your 
School  had  serious  reason 
to  believe  there  were  real 
differences  between  the 
soldiers  in  the  different 
Branches  or  MOSs  that  could 
cause  different  reactions 
to  the  lessons  and  thus 
different  training  effec¬ 
tiveness  results.  This 
is  not  bel ieved  to  be 
the  usual  case,  but  you 
should  be  aware  of  the 
possible  need  for  multiple 
group  testing,  and  should 
consider  it  in  relation 
to  each  TEC  lesson  you  are 
developing.  Use  it  when 
you  have  to. 
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TEC  LESSON  TESTING  METHODS 


•  FIXED  SAMPLE 

•  SEQUENTIAL  TESTING  SAMPLE 


- m — ii’^yn  r>  i'-inji. — nr 

TEC  contracts  let  to  date, 
two  methods  for  testing  TEC 
lessons  have  been  specified; 
those  are  the  "Fixed  Sample" 
method  and  the  "Sequential 
Testing  Sample"  method. 


Fixed  Sample.  The 
Fixed  Sample  method  requires 
you  to  select  the  number  of 
soldiers  to  be  tested  in  ad¬ 
vance  (at  least  30)-  These 
soldiers  are  then  given  a 
pretest,  TEC  lesson,  and  a 
posttest.  The  lesson  is  accept 
ed  if  for  each  training  objec¬ 
tive  (TO)  the  proportion  of 
sampled  soldiers  passing  the 
posttest  for  the  TO  exceeds 
a  prespecified  criterion  value. 
However,  in  practice  it  has 
turned  out  that  even  if  30 
soldiers  all  view  a  TEC  lesson 
at  the  same  time  in  a  group, 
they  can  rarely  be  tested 
simultaneously.  Since  testing 
(or  at  least  test  scoring) 
occurs  sequentially,  it  is 
recommended  here  that  the 
Sequential  Testing  Sample 
method  dc  used  in  all  cases. 


Sequential  Tpav ing  Sample. . 
The  Sequential  Testing  Sample 
method  requires  you  to  make  an 
entry  in  each  of  a  set  of 
charts  (one  for  each  TO)  after 
scoring  each  test.  Based  on 
these  entries,  you  then  decide 
whether  to  accept  the  lesson, 
reject  it  or  go  on  to  the 
next  test.  The  use  of  the 
charts  is  described  in  more 
detail  in  Sect  ion  cj.  1  .  5- 
While  the  number  of  soldiers 
that  must  be  tested  cannot  be 
known  in  advance  using  this 


6 


method,  experience  has 
shown  that  you  wi 1 1 
rarely  have  to  test 
more  than  30  soldiers 
before  reaching  a  de¬ 
cision  on  the  lesson. 
For  very  good  or  very 
bad  lessons,  you  will 
probably  reach  a  deci¬ 
sion  with  considerably 
less  than  30  soldiers. 
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Testing  Sequence 
tAAO U .  You  can  minim¬ 
ize  the  opportunities 
for  testing  sequence 
errors  by  reviewing 
the  TEC  Lesson  Evalu¬ 
ation  Process  in  rela¬ 
tion  to  the  questions 
below. 


1 

<] 


MINIMIZE  TESTING  SEQUENCE  ERRORS 

•  CAN  THE  VALIDATION  SESSIONS  BE  EXECUTED  WITHIN  THE  FRAMEWORK  OF 

EXISTING  ARMY  REGULATIONS? 

•  ARE  THE  IDENTIFIED  TESTING  MATERIALS  READILY  AVAILABLE? 

•  IS  THE  IDENTIFIED  EQUIPMENT  READILY  AVAILABLE? 

•  IS  THE  NEEDED  ADMINISTRATIVE  SUPPORT  READILY  AVAILABLE? 

•  ARE  THERE  ANY  OBVIOUS  ERRORS  OR  PROBLEMS  CONTAINED  WITHIN  THE  PLAN? 

•  IS  THE  PROPOSED  SEQUENCE  OF  EVENTS  CORRECT  AND  REASONABLE? 


PACteAt  Adminiitfiatio n. 
Before  administering  the  pre¬ 
test,  be  sure  that  the  stu¬ 
dents  know  the  purpose  of 
the  test  and  the  lesson 
following  it.  Explain 
the  TEC  Lesson  Evaluation 
Process,  and  provide  the 
trainees  information 
about  the  sequence  of 
events  in  which  they  will 
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be  involved.  That  is,  ex¬ 
plain  to  them  what  they  will 
be  doing  during  each  step  of 
the  evaluation  process.  Dur¬ 
ing  the  conduct  of  the  test, 
make  sure  the  testers  maintain 
an  impartial  attitude. 


Pretesting  should  be 
easy  and  routine,  if  the  proper 
prior  attention  is  given  to 
the  adini n i  s t rat  ion  requirements. 
Be  sure  the  pretest  has  been 
validated  (See  Section  5.1.1). 
Also,  students  passing  the 
pretest  cannot  continue  in  the 
evaluation  process.  Finally, 
do  not  give  any  feedback  to 
the  students  who  don't  pass 
because  they  may  learn  the 
test  and  not  the  lesson  objec- 
t i ves . 


S3 


1 


fe! 

r. 

r 

l 


FOR  PROPFR  LESSON  ADMINISTRATION 

•  BE  SURE  ALL  TRAINERS  HAVE 

REVIEWED  THE  INSTRUCTIONAL 
MATERIALS  TO  BE  EVALUATFD  IN 
DETAIL  AND  ARE  ABLE  TO  USE 
THEM  APPROPRIATELY. 

t  BE  SURE  ALL  TRAINERS  KNOW 
THAT  THEY  MUST  KEEP  AN 
IMPARTIAL  ATTITUDE  DURING 
THE  CONDUCT  OF  A  LESSON 
AND  DO  SO. 

•  INSURE  THAT  THE  TEST 

ITEMS/ANSWERS  ARE  KEPT 
FROM  COMPROMISE. 
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Lesson  Adn  inostAcUUon . 

Since  your  goal  is  to  determine 
the  training  effectiveness  of 
a  TEC  lesson,  you  must  be  sure 
that  the  test  situation  dupli¬ 
cates  the  real  learning  situation. 
If  the  lesson  is  going  to  be  used 
in  a  learning  center,  try  to  vali¬ 
date  it  using  a  learning  center 
environment.  If  the  lesson  is 
for  field  or  maintenance  hanger 
use,  test  it  in  that  situation. 

When  a  TEC  lesson  is  ready 
for  evaluation  in  a  large  group 
trial,  the  lesson  v/i  1  1  usually 
be  in  the  sound-slide  stage  of 
development,  with  only  one 
copy  being  available  for  use 
in  the  evaluation.  For  this 
reason,  most  schools  elect  to 
present  the  lesson  to  the  sam¬ 
pled  soldiers  in  groups  of  five  . 
or  more  at  a  time  rather  than 
having  each  soldier  view  the 
lesson  individually.  However, 
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it  Should  be  kept  in  mTntl 

that  when  a  lesson  is 
viewed  in  a  group  mode, 
the^e  is  1 i 1 1 1 e  or  no 
self-pacing.  For  certain 
tasks  (disassembly  of  a 
M60  machinegun  for  ex¬ 
ample)  the  lack  of  self¬ 
pacing  may  decrease  the 
effectiveness  of  the 
lesson. 


PosttcAt  AdminiAt'uiCi.oii. 
The  post  test  does  not  have 
to  differ  from  the  pretest. 
Therefore,  the  procedures, 
materials,  equipment,  and 
manpower  required  for  the 
posttesting  effort  can  be 
essentially  the  same  as 
those  required  to  imple¬ 
ment  the  pretest  effort. 


CONSIDERATIONS  FOR  POSTTEST  ADMINISTRATION 

•  HAVE  POSTTESTING  PROCEDURES  BEEN  CLEARLY  IDENTIFIED? 

•  ARE  THE  TYPES  OF  TESTING  FACILITIES  NEEDED  (RIFLE  RANGE,  CLASSROOM 

DRILL  FIELD,  ETC.)  IDENTIFIED  AND  AVAILABLE? 

t  ARE  THE  REQUIRED  TESTING  MATERIALS  (BOOKS,  PAPER,  FILM,  PENCILS, 
ETC.)  IDENTIFIED  AND  AVAILABLE? 

9  IS  THE  NEEDED  TESTING  EQUIPMENT  (HARDWARE,  PROPS  LIKE  LAW  OR 
A  RADIO,  ETC.)  IDENTIFIED?  IS  IT  AVAILABLE? 

•  IS  NEEDED  MANPOWER  (  NUMBER  OF  TESTERS,  AIDES  TO  GRADE,  TRAINERS, 

ETC.)  IDENTIFIED?  IS  IT  AVAILABLE? 


After  the  post- 
tesl  you  should  provide 
full  feedback  of  results 
to  each  trainee  and  ques¬ 
tion  each  one  about  the 
quality  and  acceptability 
of  the  lesson.  Although 


bearing  on  the  acceptability 
of  the  lesson  in  the  stat i st ica l 
sense,  these  often  provide 
you  with  the  best  information 
about  where  to  start  in  further 
revisions  to  the  lesson  if  it 
should  be  rejected.  Even  if 
the  lesson  is  accepted,  the 
trainee  comments  should  be 
seriously  considered  and  when 
faults  have  been  identified 
which  can  be  easily  or  cheaply 
corrected,  these  revisions  should 
be  marie.  Remember,  these  'oldiers 
are  the  people  you're  design¬ 
ing  the  lesson  for.  Their 
opinions  are  important  and  can 
make  your  job  easier  and  your 
output  better.  Even  effec¬ 
tive  lessons  won't  train  if 
people  don't  use  them;  and  if 
the  soldiers  don't  like  them, 
they  won't  use  them.  Pay 
attention  to  the  consumer! 


TRADOC  PAMPHLET  350-30.  I  SO  Phase  111.  Fort  Monroe,  Virginia:  U  S. 
Army  Training  and  Doctrine  Command,  August  19/5.  (Pp.  31 2 - 3? 8 
discuss  group  trial  preparation,  target  evidence  determination  and 
drawing  a  sample.) 

5.1.5  Va 1 i dot  ion  Dec i s i on- 
Makinq  Phase 


This  phase  of  TEC  effec¬ 
tiveness  evaluation  is  critical 
and  is  perhaps  the  most  complex 
procedural  1 y .  Based  on  the 
rccominendat  ion  of  Sect  ion  5.1.^, 
above,  we  present  only  the  process 
for  making  the  decision  about 
lesson  validity  based  on  the 
sequential  sampling  decision 
technique.  This  technique  pro¬ 
vides  high  confidence  that 


will  oe  trained  to  the 
selected  criterion  with 
the  least  expenditure  of  man¬ 
power  and  other  resources. 

The  rules,  given  below, 
will  assist  you  in  eval¬ 
uating  the  effectiveness 
of  a  TEC  lesson. 


RULES  FOR  EVALUATION 

•  INSTRUCTION  SHALL  3E  EVALUATED  ON  AN  OBJECTIVE  BY  OBJECTIVE  BASIS. 

•  ALL  OBJECTIVES  SHALL  BE  ACHIEVED  ON  A  GO  -  NO  GO  BASIS. 

t  EACH  OBJECTIVE  SHALL  HAVE  BEEN  RATED  FOR  IMPORTANCE  AND  CERTIFIED 
ACCEPTABLE  BY  A  MEMBER  OF  THE  SERVICE  SCHOOL  OR  OTHER  GOVERNMENTAL 
OFFICIAL. 

•  DECISION  CRITERIA  FOR  LESSON  EFFECTIVENESS  Vi  ILL  VARY  WITH  THE 

IMPORTANCE  OF  THE  OBJECTIVE. 


Seeking  btj  Objective-. 
All  posttests  must  be  scored 
in  correspondence  with  the 
criteria  defined  for  pass/ 
fail  with  respect  to  each 
objective.  These  criteria 
relate  to  the  correct  ans¬ 
wers/performance  in  response 
to  each  criterion-referenced 
item  related  to  each  train¬ 
ing  objective.  They  must 
have  been  defined  before 
hand  by  school  personnel 
and  made  into  a  scoring 
key  for  the  post  test. 

Each  soldier's  responses 
on  the  post  test  are  now 
scored  with  this  key. 

After  individual  respons¬ 
es  are  scored,  it  must  be 
determined  whether  the 
soldier  has  passed  or 
failed  with  respect  to 
each  training  objective. 


The  GOs  and  HQ-Gos  for 
each  soldier  are  the  data 
you  use  to  determine  whether 
the  lesson  is  training 
effective  for  each  objec¬ 
tive.  These  scores  must 
be  entered  on  the  appropri¬ 
ate  charts  in  the  order 
scored  to  preserve  the 
validity  of  the  process 
(see  the  Plotting  Scores 
Sect  ion  below) . 

S tl ecTi nq  Cli&ntA  i (o-T 
Each  1 'Kilning  ChjecXxv e. 

The  TEC  contracts  include 
five  distinct  charts  (for 
the  sequential  scoring 
process)  to  be  used  to 
evaluate  the  training 
effectiveness  of  a  TEC 
lesson  with  respect  to 
each  objective.  The  chart 
to  be  used  for  each  objec¬ 
tive  is  determined  by  the 
importance  rating  (given 
below)  assigned  to  that 
objective  (that  is,  there 
is  a  specific  chart  assoc¬ 
iated  with  each  importance 
rating).  Remember  you  are 
not  responsible  for  determin 
ing  the  importance  of  the 
objective.  You  art^  respons¬ 
ible  for  seeing  to  it  that 
the  objective  has  been 
rated  with  respect  to  its 
importance. 


IMPORTANCE  RATING  FOR  EACH  OBJECTIVE  IS  DETERMINED  BY: 

•  THE  CONSEQUENCES  OF  INADEQUATE  PERFORMANCE  OF  THE  OBJECTIVE. 

•  THE  TIME  AVAILABLE  FOR  LEARNING  ON  THE  JOB. 

•  THE  AVAILABILITY  OF  TECHNICAL  ASSISTANCE  AND  REFERENCES  ON  THE  JOB. 


•  THE  AMOUNT  OF  INSTRUCTION  AVAILABLE  CONCERNING  THIS  OBJECTIVE  AND 
AMD  THE  NUMBER  OF  PLACES  WHERE  THAT  INSTRUCTION  IS  AVAILABLE. 


Number  of  NO  GOs 


An  example  of  a 
sequential  testing 
chart  is  shown  below. 


SEQUENTIAL  TESTING  CHART  -  AN  EXAMPLE 


LESSON  NO. 

NIT  TITLE  _ 

OBJECTIVE  NO.  _ 

CERTIFICATION 

(SIGNATURE  OF  U.S.  GOV.  REP.) 


Number  of  Trials 


HIGH 

DESIRABLE 

LOW 

cl  =.05 


P 


75% 

65% 

55% 

-.25 


Plotting  GO -HO  GO  Sc.o^qs  . 
As  illustrated  above  the 
sequential  testing  charts 
are  graphs  on  which  are  to 
be  plotted  to  the  GO-NO  scores 
of  each  soldier  with  respect 
to  an  individual  objective. 

Five  numbers  are  given  on 
each  chart.  These  are  a 
"High",  "Desi'able"  and 
"Low"  value  tor  the  percent 
of  soldiers  receiving  a  GO 
on  the  test  for  a  given 
training  objective,  along 
with  two  other  numbers, 

"«l"  and  "p" .  The  numbers 
are  interpreted  as  follows: 

•  CL,  i  s  the  probability 
that  an  objective  would 
be  rejected  if  the  per¬ 
cent  of  soldiers  in  the 
target  population  receiv¬ 
ing  GO  for  that  objective, 
after  reviewing  the  lesson, 
were  equal  to  the  "H:jh" 
value. 

®  /3  the  probab i 1 i ty 
that  an  objective  would 
be  accepted  if  the  percent 
of  soldiers  in  the  target 
population  receiving  GO 
for  that  objective,  after 
reviewing  the  lesson,  were 
equal  to  the  "Low"  value. 

The  horizontal  axis  counts 
the  number  of  trials  (soldiers 
taking  the  test)  and  the  verti¬ 
cal  axis  counts  the  cumulative 
number  of  NO  GOs.  The  graph 
is  simply  a  mechanical  way 
to  determine  whether  the  lesson 
should  he  accepted  or  rejected, 
based  on  the  results  of  the 
tests,  for  that  objective. 

The  parallel  lines  on  the 
chart  mark  the  regions  for 
acceptance  or  rejection. 


The  area  on  each 
group  between  the 
d  i  ogona 1  I i nes  i s  the 
"continue  testing 
area."  Above  the 
I  i nes  is  the  "reject" 
area.  The  area  below 
the  1  i nes  is  the 
"accept"  area. 


To  nark  the 
charts,  place  an  X 
on  the  graph  for  each 
trial  .  Regardless  of 
how  you  have  presented 
the  lesson  to  the 
soldiers  -  one-by-one, 
in  a  large  group,  or 
in  a  series  of  sma 1  I 
groups  -  data  must 
be  recorded  in  the 
order  tested  and  onc- 
at-a~tirnc.  If  soldiers 
are  tested  individually, 
plot  the  data  immedi¬ 
ately  after  each  test. 
This  is  the  optimum 
procedure  and  wi  I  1 
maximize  the  bene¬ 
fits  of  the  sequential 
testing  and  scoring 
method.  If  soldiers 
are  tested  i n  smal 1 
groups,  score  and 
record  al 1  data 
collected  after  each 
group  and  before  you 
test  the  next  group  - 
you  may  not  have  to 
do  any  more  test i ng 
at  all. 

Each  successive 
trial  is  plotted, 
hor i zon ta 1  I y  along 
the  chart.  MO  GOs 
are  plotted  to  the 
right  and  up  one 
box,  GOs  are  plotted 
just  to  the  right. 

For  example: 


Vertical 


Number  of  Trials 


5-35 
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3  4  5  6  7  &  0  10 

Number  of  Trials 


1  2 


Number  of  Trials; 


I  f  the  first  trial 
i s  a  NO  GO,  place  an  X 
in  the  1  column  for 
Number  of  Ti ials  beside 
the  1  row  for  Number  of 
NO  GOs. 


If  all  the  trials 
are  NO  GOs,  the  chart 
would  look  like  this 
and  the  4th  trial  is  in 
the  reject  area  and  test¬ 
ing  can  stop  (providing 
that  a  decision  has  been 
reached  on  al 1  other 
training  objectives). 


If  the  first  trial 
is  a  GO,  place  an  X  in  the 
1  column  for  Number  of 
Trials  and  beside  the  0 
row  for  Number  of  NO  GOs. 


* 


<  a  u 


VEC1SI0N-MKJNG  PHASE 


for  each  object i ve 
in  the  lesson.  Test- 
i ng  must  cont i nuc 
until  a  dec i s i on  has 
been  reached  on  a  I  I 
training  objectives. 


Acceptance/ Re¬ 
jection  TEC  Lc&Aon 
hij  Objective..  The 
procedure  described 
above  must  be  carried 
out  for  each  train¬ 
ing  objective.  V/hen 
this  has  been  accomp- 
1  i  shed ,  you  can 
determine  d i rec t ly 
from  your  charts 
which  training  ob¬ 
jectives  have  been 
successful l y  ac¬ 
complished  by  an 
acceptable  number 
of  soldiers  and 
wh i ch  object i ves 
have  not.  At  this 
point  there  is  no 
decision  to  be  made 
about  the  training 
effectiveness  of 
the  lesson  wi th 
respect  to  each 
objective:  this 

has  been  shown  by 
the  data  -  the 
1 esson  ei ther 
teaches  wel 1  or 
it  does  not  for 
each  object i ve  . 

The  decision  now 
i s  wi th  respect  to 
the  total  lesson: 

Is  it  effective 
enough  to  be  sent 
forward  for  final 
development?  Is 
i t  effect i ve  enough 
to  be  worth  revising 


DECISION -MAKING  PI  I  AS  C 


where  it  is  weak?  Or, 
is  it  so  poor  that  it 
should  be  scrapped  and 
started  over? 

I f  the  1 esson  has 
satisfactorily  met  the 
criteria  on  all  train¬ 
ing  objectives  (and  if 
trainee  comments  have 
not  indicated  any  serious 
quality  or  acceptance 
problems)  the  lesson  should 
obviously  be  passed  on  to 
the  final  stages  of  develop¬ 
ment,  production  and  dis¬ 
tribution.  If  the  lesson 
has  achieved  the  criteria 
with  respect  to  most  of 
the  objectives,  it  prob¬ 
ably  should  be  worth 
revision  and  retesting  to 
produce  a  training  effec¬ 
tive  lesson.  It  appears 
that  only  lessons  which 
totally  fail  to  train  on 
any  of  the  major  objec¬ 
tives  should  be  scrapped. 

Any  lesson  which 
fails  to  validate  with 
respuct  to  any  training 
objective  must  be  revised. 
Depending  on  the  extent  of 
failure,  the  revision  may 
require  going  back  to  the 
early  (£•£.,  Individual 
trials)  stages  of  effec¬ 
tiveness  evaluation  pro¬ 
cedure.  But,  whatever  the 
extent  of  revision  that  is 
required  and  accomplished 
after  this  stage,  the  les¬ 
son  must  be  reevaluated 
through  the  training  effec¬ 
tiveness  testing  phase  - 
using  another  sample  of  the 
appropriate  target  population. 
That  means  that  when  revisions 
are  completed,  you  must  start 
all  over  with  Sections  5*1. 


5-- *40 


and  5.1.5.  The  process 
must  be  performed  fully 
and  accurately  to  assure 
that  the  soldiers  in  the 
field  get  the  "certified 
tra.ning  effective"  lesson 
that  we  have  promised 
them. 


B LbdA.og'iapluj  {^on  5.1.5 

TkAOOC  PAMPHLET  i* 50-30.  ISP  Phase  111.  Fort  Monroe,  Virginia:  U.  S. 

Army  Training  and  Doctrine  Command,  August,  1975.  (Pp.  31 7 “ 32 7 
discuss  the  sequential  testing  procedure.) 

TRADOC  PAMPHLET  350-31.  (Draft)  Preparing  extension  training.  Fort 

Monroe,  Virginia:  U.  S.  Army  Training  and  Doctrine  Command,  February 
1976.  (Pp-  60-68  provide  an  example  of  sequential  testing.) 


Consult  Recent  TEC  Requests  for  Proposals  (RFPs)  for  any  specific  guidance 
that  may  be  provided  for  large  group  validation  procedures. 


5.2  MONITORING  THE  CONTRACTOR'S 
DEVELOPMENT  EFFORT 


IF  THE  LESSON  IS  UNDER  CONTRACT,  THE 
CONTRACTOR  WILL: 

•  IDFNTIfY  PROCEDURES  AND  NEEDS  FOR 

ADMINISTERING  THE  PRETEST. 

•  IDENTIFY  PROCEDURES  AND  NEEDS  FOR 

ADMINISTERING  THE  TEC  LESSON. 

•  IDENTIFY  PROCEDURES  AND  NEEDS  FOR 

ADMINISTERING  THE  POSTTEST. 

•  IDENTIFY  A  METHOD  FOR  MEANINGFULLY 

REPORTING  TRAINEE  COMMENTS. 

o  IDENTIFY  EFFECTIVENESS  DECISION 
MAKING  CRITERIA  ACCORDING  TO 
CONTRACT  SPECIFICATIONS. 


The  previous  sections  (5-1.1 
5.1.5)  described  what  you  had  to 
do  in  order  to  produce  effective 
lessons.  Because  lessons  can  be 
produced  both  in-house  and  under 
contract  you  can  apply  these 
guidelines  to  in-house  lesson 
development  and  use  them  as  a 
basis  for  monitoring  what  the 
contractor  does . 


5.2.1  The  TEC  Manager's  Role 


When  a  TEC  lesson  is  being 
developed  under  contract,  you 
have  two  primary  roles.  First, 
you  are  an  evaluator.  In  your 
role  as  an  evaluator,  you  are 
responsible  for  assuring  the 
government  that  the  contractor 
has  properly  conducted  an  evalu¬ 
ation  effort  for  the  newly 
developed  TEC  lesson.  You  ore 
also  responsible  for  certifying 
the  results  of  the  effort.  That 
is,  you  insure  the  government 
that  validation  results  presented 
by  the  contractor  are  the  ones 
that  actually  occured. 

Your  second  role  is  that  of 
a  facilitator.  Here,  you  assume 
the  responsibility  of  assisting 


the  contractor  in  accom¬ 
plishing  his  task  by 
helping  him  secure  neces¬ 
sary  military  cooperation 
in  terns  of  personnel 
(administrative  support), 
testing  facilities,  soldiers 
from  the  target  audience, 
equipment,  and  other  items 
requisite  to  the  implemen¬ 
tation  and  conduct  of  his 
evaluation  effort. 

Ask  the  contractor 
for  a  time  schedule  that 
reflects  where  and  when  he 
wi I  1  be  conducting  each 
phase  of  his  evaluation 
effort.  When  you  receive 
the  schedule,  compare  the 
events  planned  into  the 
effort  with  those  in  the 
TEC  contract  under  which 
he  is  operating.  Remember, 
a  school  representative 
must  be  present  for  al  1 
trials  and  lesson  evalu¬ 
ation  sessions. 


5.2.2  Minimizing  Error 


There  are  two  pri¬ 
mary  opportunities  for 
error.  First,  errors  can 
occur  on  the  part  of  the 
contractor  as  a  result  of 
a  misunderstanding  of  the 
contract  specifications. 
Second,  errors  can  occur 
on  your  part  as  a  result 
of  misunderstanding  the 
contractor's  responsi¬ 
bility  for  provi d i ng 
testing  materials  and 
not  being  aware  of  the 
Government's  responsibility 
for  providing  military  equip¬ 
ment  needed  to  conduct  the 
evaluation  effort.  In 


general,  errors  will  be 
minimized  when  the  guidance, 
given  below,  is  followed. 


MINIMIZING  ERROR 

•  IN  ORDER  TO  INTER  THAT  THE  TRAINING  MATERIALS  ARE  EFFECTIVE 

UNDER  THE  INTENDED  CONDITIONS  OF  USE,  THE  STUDENT'S  EXPOSURE 
TO  THE  MATERIALS  DURING  THE  ADMINISTRATION  OF  THE  LESSON 
SHALL  MATCH  THE  INTENDED  CONDTIONS  FOR  USE  OF  THE  MATERIALS. 

•  THE  CONTRACTOR  SHALL  PROVIDE  THE  FOLLOWING,  PRIOR  TO  COMMENCEMENT 

OF  EACH  VALIDATION  TEST: 

-  A  LIST  OF  EQUIPMENT,  e.g.  ,  35  MM  PROJF.CTORS,  TAPE  CASSETTE 

PLAYERS  AND  ANY  MILITARY  EQUIPMENT  FOR  PERFORMANCE  TESTING 
REQUIRED.  EQUIPMENT  WILL  BE  PROVIDED  3Y  THE  GOVERNMENT. 

-  A  LIST  OF  MATERIALS  PROVIDED  BY  THE  CONTRACTOR,  e.g.,  STORY¬ 

BOARDS  AND/UR  35  MM  SLIDES,  SCRIPT  AND  SCRATCH  TAPES  (AV  KIT) 
VISUAL  DUMMY  (PT  KIT)  AND  SCRATCH  TAPE  (AO  KIT). 


MINIMIZING  ERROR 


When  the  contractor  is 
ready  to  implement  t tie  evalu¬ 
ation  effort,  he  must  notify 
you.  (Refer  to  the  TEC  con¬ 
tract  for  details.)  Once 
properly  notified,  the 
Government  will  supply  all 
of  the  military  equipment, 
subjects,  and  material 
requisite  to  conducting 
the  evaluation  effort.  The 
contractor,  however,  is  re¬ 
sponsible  for  supplying 
certain  materials.  Errors 
here  could  nul I i cy  the 
trials. 


MATERIALS  TO  BE  PROVIDED  BY  THE  CONTRACTOR 
(AS  REQUIRED) 

•  SUFFICIENT  COPIES  OF  PRE-  AND  POSTTESTS  AND  ANSWER  KEYS. 

•  NECESSARY  FORMS  FOR  RECORDING  PERTINENT  INFORMATION  CONCERNING 

TRIAL,  e.£. ,  STUDENT  RESPONSES,  PRE-  AND  POSTTEST  RESULTS. 

•  INSTRUCTIONS  TO  THE  STUDENT,  e.£. ,  TIME  LIMITS,  IF  ANY, 

ACCURACY  OR  SPEED. 

•  GUIDANCE  FOR  THE  EVALUATOR  ON  ANSWERING  STUDENT'S  QUESTIONS. 

•  ANY  OTHER  MATERIAL  NECESSARY  FOR  THE  TRIAL,  e.3.,  ANSWER  SHEETS, 

NOTE  PADS,  AND  REFERENCE  DOCUMENTS. 


Remember,  a  Govern¬ 
ment  representative  must 
certify  each  test  result 
Remember,  also,  that  the 
contractor  must  provide 
personnel  to  administer 
the  test. 
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DISTRIBUTION  OF  TEC  LESSONS 

•  PREPARATION  AND  SHIPMENT  OF 

-  LAIs 

-  SISs 

-  HISTORICAL  PACKAGE 

c  TEC  LESSON  ANNUAL  REVIEW 
a  SAFETY  VIOLATION  PROCEDURES 

•  SAFEGUARDING  CLASSIFIED 

INFORMATION 


The  first  sections  (6.2  - 
6. A)  of  this  chapter  cover  the 
final  stages  of  TEC  lesson  devel¬ 
opment  and  the  role  the  TEC 
manager  must  play  to  insure  that 
the  TEC  lessons  enter  into  the 
distribution  process  in  good  shape. 
That  is,  the  TEC  manager  must  see 
to  it  that  the  Lesson  Adminis¬ 
trative  Instructions  (LAIs)  and 
the  Student  Instruction  Sheets 
(SISs)  are  prepared  and  shipped, 
the  historical  package  is  put 
together  and  shipped,  and  any 
adjunctive  material  (Army  Fits 
or  TMs)  required  of  a  TEC 
lesson  are  properly  requested 
from  the  AG  Centers. 

The  last  sections  of 
this  chapter  provide  intital 
guidance  for  conducting  the 
TEC  Annual  Review,  procedures 
for  a  safety  violation  noted 
in  a  TEC  lesson,  and  safe¬ 
guarding  classified  information. 
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6.1  PREPARING  LAIs  AND  SISs 


Concurrent  with  the  development 
of  each  TEC  lesson  you  will  develop 
the  accompanying  LAI  and  SIS.  The 
LAI  provides  detailed  information 
on  the  TEC  lesson  while  the  SIS  is 
a  brief,  concise  outline  to  assist 
students  in  the  use  of  the  lesson. 
TEC  Training  Managers  use  this 
information  to  make  decisions  on 
the  need  for  the  lesson  in  their 
training  programs,  the  use  of  group 
or  individual  nodes,  and  so  forth. 
Included  in  the  LAI  is  the  pretest. 
This  pretest  is  the  same  as,  or 
equivalent  to,  the  Ciiterion  post¬ 
test. 


6.1.1  V/ri  t  ing  the  LAI 


LAIs  have  a  standard  format. 
Users  familiar  with  the  LAIs  can 
quickly  extract  the  desired  infer 
mat  ion.  They  must  be  written  to 
the  target  audience  just  like  a 
TEC  kit  --  brief,  concise,  clear. 
The  format  given  below  should  be 
fol lowed . 


LAI  FORMAT 


Common 

TYPE  OF  lESSON  :  Semi-Common 

Branch/MOS 


Administrative  Instruc- 
t  ion  TEC  Lesson  fio. 


(Name  of  Lesson) 


1.  Training  Objectives:  Soldiers  completing  this  lesson  should 

be  able  to: 


Verb  +  object  +  (complement) 
Verb  +  object  +  (complement) 


a . 

b . 

2.  Pre training  Actions: 


a.  Prerequisites:  Many  TEC  lessons  require  that  the 

soldier  have  certain  prior  knowledge 
or  skills  before  taking  the  lesson. 
Isolate  these  prerequisites  and 
define  them  in  terms  of  other 
required  lessons  or  tasks  that 
the  soldier  must  be  able  to  perform. 

b.  Test:  This  is  the  diagnostic  pretest  to  determine 
whether  the  soldier  needs  the  lesson.  This 
test  is  either  a  PERFORMANCE  TEST  or  a 
CRITERION-REFERENCED  TEST.  You  can  combine  the 
two,  if  necessary. 

The  PERFORMANCE  TEST  contains  all 
needed  instructions  an-!  details 
for  a  real  world  performance  test. 

The  CRITERION-REFERENCED  TEST  is  a 
written  test  containing  criterion 
.  test  facts  from  the  lesson  itself. 

This  paragraph  in  the  LAI  provides 
the  guidelines  for  the  test  and 
the  standards  for  determining 
whether  the  soldier  needs  the  lesson. 

3.  lesson  Materials:  This  paragraph  describes  the  compon¬ 

ents  making  up  the  TEC  lesson  (audio¬ 
visual  kits,  audio  tapes  only,  skill 
practice  exercises,  etc.). 

<*.  Equipment  and/or  Materials  Required:  This  paragraph 

precisely  describes  the  items  a 
soldier  must  have  in  his  possession 
to  adequately  take  the  lesson.  Every¬ 
thing  must  be  specif  i  eel  (weapon,  pencil 
and  paper,  etc.).  Also,  you  specify 
here  how  lesson  materials  can  be 
reordered  or  resupplied. 

5.  Length :  This  paragraph  indicates  the  average  length  of 

time  the  lesson  takes  in  both  group  and  individ¬ 
ual  modes.  The  exact  or  average  time  for  the 
stimulus  presentation  is  given  first. 


k 


a.  Stimulus  Time: 


minutes 


b. 

minutes 

--  Individual 

c . 

minutes 

--  Group 

6.  Additional  Study  References:  List  specific  study 

references  related  to 
the  lesson  objectives. 

Give  the  page  and/or 
paragraph  numbers  in 
the  FMs  and  TMs. 

7-  Skill  Pract i ces :  This  paragraph  provides  trainers 

with  guidance  on  skill  practice 
exercises  necessary  to  develop 
proficiency  in  the  tasks  learned 
from  the  TEC  lesson.  You  may  refer 
the  trainer  to  other  training  material 
or  provide  instructions  in  an  inclosure. 

8.  Recommendations  to  the  Instructor:  This  paragraph  goes 

beyond  the  general  information  already 
provided.  It  gives  trainers  specific 
suggestions  on  how  to  get  maximum 
efficiency  from  the  TEC  lesson.  These 
recommendations  should  be  essential  to 
the  development  of  a  sound  training 
program. 

The  approach  in  TEC  IV  is  to  use  one- 
liners  as  often  as  possible.  This 
approach  is  quick,  direct,  and  to 
the  point.  For  example: 

•  Recommendations  to  the  Instructor:  This 
lesson  is  self-contained  and  needs  no 

special  consideration  when  used  in  the  individual 
mode  except  for  gathering  the  equipment  and/or 
materials  required.  A  maximum  of  10  soldiers  is 
recommended  for  group  mode.  Place  pretest  in  a 
document  protector  and  use  a  grease  pencil  to 
conserve  paper. 

•  Recommendations  to  the  Instructor: 

a.  Distribute  the  lesson 

b.  Hake  sure  the  soldier  has  all  required 
materials  and  equipment 

c.  Use  no  more  than  10  students  for  group  study 

d.  Keep  the  pretest  in  a  document  protector 

e.  Use  grease  pencil  to  conserve  paper. 


EXAMPLE  OP  A  WRITTEN  LAI 


tm  Of  LAIAOtff  Comte  ;  Aiihlaat 
H  Ut»U  to  all  ioUUw  In  th 
Coobar  dm  f  i  * 


AJalnlatratlva  fnar ructions 
tu’  laaaon  |  Id-AM-mt-r 


li.t  I.  . .  I  »» 4  I  -  »'  T  l 


1  Tf*Ulhf  Pol«sd»Mt  ioldlara  cooplatlnj  thla  lataon  ahoul*  M  at>la  re 

•  liantlfy  tha  Mirocf  poaitton  *"4  t«»p  for  firing  lha  ntJ  on  tta  bipoA 
and  trljxvl. 

h.  CaUulata  Ofjiciun  con  action. 

a.  Ur  tno  wi^oit1*  l  hr  a  a  n«t«o  of  fUa  «n«I  uhan  tha  banal  »h:ulj  b« 
uha.tf*4  for  oajfc. 

1  Ft!  l!!iatii.A2UsU*1' 

a.  Praioqulat  t-'ai  Tna  foll'Mln*  *uar  r»a  takan  aa  a  prarapuito  to  thia 
taaooni 

la**ut  |  141  -  llt-OOIl  f,  Tlsa  h  0  Nachmr^un  function  i| 

lota. in  1  Id  III  DJIl-f,  Tha  h*J  Na  -Hua^un  ha-flr*  fro.almua 
.'t  la  r*corv>«nlaJ,  r..—«var,  tnai  tna  adjiar  at-w  thta  l<«»on  hy  f  iIIom  <,  tha 
•  aria*  on  tha  h*0  na<hlnajun  in  r.wjvn  I  al  ordai 

h  T •  1 1  n.|i  Adnnlasar  tha  Pra-Taat  to  4*>l*i  »l  a  tha  I  .JivUud  aulliat'a 
ability  to  «8cnaplith  tha  tralntn|  t  nha. 


)  (aiaojt  S'/fijlt,  Tma  lain  <n 

t-d.o  <r»«..*tt  ’  ~~ 


I  »l<tl  .‘f  or  fll**ltl(,  *«irtdj**  aiJ  ■ ,  r.  ■ 


*  Hatajfi  »ta  Ii.ivi4*.1  To  c»»»rlaia  tma  l  ■>  »*»  in*  id  tiac 
ru*r  ii* v-  p«n  II  *fnf~p«;>*r !  FiltfaT  lit  .»*  t  «•  pit  UM  lor  »•  .  h  |-**k,n  [• 

Ji  *  t  a  1  with  tha  la*  ton  ■  Ti>a  |l  t  a  a  at.o  ild  ba  |>l  i  J  m  4  .  uat.it  |  rutt- 
toca  n.1  •talt’l  t»|*lia!  r  a*a  ijt«*a*  |*r>cil  lo  cbmorv*  pifoi  Alittional 
^la*  “•  tna  p  *-t«at  am  <•  <  locally  r|<i  u.l, 

*  UnjtM  In4ivi4ja|  ay-pilctU  i  IA  ftlnut**A 

CfdUp  appllt.tl  I  44  olNUtae 

t  *  4j  a  .Ij  htt.tn  ■  •  i  Tt  •  lb  *4  JJ4-13,  Ki  d-al 

t;  In  *tf-*»~»ra  Im*  nan-ufa  a**.l*M«  to  an*  a>Ui  r  im  irtiMi)  at!  MlMta 
*.-.  1  of  Iha  a«J  Jl.hiraj.tn.  T.»**  *«n.a|j  vat  Ijia'I  lavlt  .  •;  |M  ttaj  th.a 
l  it  <n  i»ro1  1  "n  *  |»<ici  *ni  if*  *  I  tn*  l*«  i  nr.  i 

n  *t.hiM|.n,  an:  ml*  i»f  jrnar  ini  *111  l»a  IncluJ*  |  1  tha  ia.iu.ini.  * 

).  *AtlJ_  ftjcj  «i  Tha  »«i*rlal  cov*.al  in  thla  laaaoi.  ao..lil  t»-  put  1  r  t  > 
pr«  i  {  on*  tKa  Him  av  ,  i  |abp  tr«int>qd«y  invalalna  a  1 1  v*  f  it  a*«rc.«a  at 
■  .it  rl^mi  *4  ft  4$  Of  t  *14  tialnir<4  a*at<|«a  galny  bltn*  *'.itr.Min  Oufinj 

m  la  *  *  kiitfir  that*  ata  a  pall  of  a*aiw  i«a  that  ah-ul4  la  •  1  hi  in  a 

elaitic  «  anfliunnane .  Flr.f  )j.a  aaoh  ailliif  irartlr*  ?u*|tm.<  a  ».l  jnp  o.i 

j  bitv.4  *n.l'ot  |iiy)4  ftrtdaa  of  t  .a  HU  N«*t  h*u*  »h  aMJur  i’rlcj||<* 

tfjflactttm  ar.4  ran<j«  aim*.  Tna  Ini.iactai  naad  only  4  uw  *  ta:jvi  and  i-j/4* 
aulKlnf  a*iy  f.c#  tna  i«t<j«t  on  a  t>tackr>oacd.  Th*  Inaiyu  toi  ik«r  qtvat  tha 
rauja  t  a  tha  fan  to  t  ia  r*rjal  «n4  ftua  thar  .  tha  aoldiar  n|  nil  .1  HI* 

4af  la.*t  t.w  coiraetio  tna  a  ill»i  tnan  ««k*a  tha  appropfiai*  criii.ilu  on 
hia  nanpon. 

I  h  •ana lilt  I  tr#  l  adwctjjp  Thla  la*aon  it  **lf-;j.M«i  cl  oh*.*  u*a4 

li  tl  TmJfvTI-al'aol*.  **•  apt  for  ^alhartn^  tha  equip-*  •!  •'•4  n»  *«t*ilil* 
ia<i4ii*4.  A  atalnio  of  U  aulliaia  la  r*coroanJa4  f  >r  rha  «.»*!;■  aol/.  A*via* 
i  •  TIC  la*aon  a  |  apr^priaia  rafatarcaa  prior  to  fhi  q  *  cl**.. 

In  oi<l»i  to  ettam  t}.*  a«*|apa  n.  iafit  fiu*  thta  la*P^^^^^^^^ 
a*  |i4ir«t*4  In  pita  J«  Of  tha*a  In.tnoimna 

T i 1  •  th*  pr*  t*«t  and  put  thaa  to  doruo*  t  prot.  -t«>r 

c  >r*arv  *  pap^r.  pjtj  TfcSt/VlaW/H  Y  i'.Y 
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TH*.  K'J  ■ 
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■rn.  I,  A,.  ,w.r  l.-y  **  U"  »  «  •  -•  f  " 

f- “ft  r!  j  (utt  cSrrv^i, 

tr«  H.tJ  • '*  *  '  '  ,  ,ha  ('iv  ,  if  i. 


f.4  1  O.I>  Dt  •  .,  ...  .  .  t  j  r  , 

t lattt  II  U.M  no.-,  -t  I(  f>:  M  *  <y 
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The  SIS  is  simple.  Take  the 
LAI  and  transfer  the  information 
required  for  the  SIS  according 
to  the  format  given  below. 


SIS  FORMAT 


STUDENT  INSTRUCT  I  ON  SHEET 

Lesson  No. _ 

(Lesson  Title) 


AUDIENCE: 


Applicable  to  what  group  of  soldier 


TRAINING  OBJECTIVES: 


Soldiers  completing  this  lesson  should  be 
able  to: 

a . Verb  +  object  +  (complement) 

b . Verb  +  object  +  (complement) 


MATFRIALS  REQUIRED; 


This  is  a  list  of  materials  needed  to 
comoletc  the  lesson. 


TIME: 


•  Overall  time  needed  to  take  lesson  (includes 
both  stimulus  and  response  times). 

GENERAL  INSTRUCTIONS: 


•  If  you  have  never  taken  a(n) _ _ 

(medium  of  lesson)  TEC  lesson  before,  ask 
for  assistance. 

•  Work  through  the  lesson  ns  many  times  as 
necessary  to  master  all  skills  taught. 

PREREQUISITE: 

•  TEC  lessons,  if  any,  that  arc  prerequisites 
to  this  lesson  should  be  listed  here. 


IWitPA. ife •  > JjUt !IR  KJ5N  53®  *  -'t»  —  ~  ? 


Tiwr'iT-'  mi# 


tv;; 


STUDENT 

INSTRUCTION 

SHEET 

L.E**OH  NO  LM-ltlMt!  A 


Add  information  to  SIS 
that  wi 1 1  cross-reference  the 
LAI.  For  example,  under  General 
Instructions  you  might  add: 

•  If  you  think  you  can  perform 
t he  training  objectives,  ask 
your  supervisor  for  the  pre¬ 
test  in  the  Lesson  Adminis¬ 
trative  Instructions. 


•  pt*c«  t.iw-lixiiilnj  pt/ry  call*. 

•  Flic#  •fT«rg«ncy  cUl*  ta  but/ 

MMEflIAU  RIGUi^cO: 

•  Bd-M/P  (Op«ut^njl| 

•  Pari.il  *nd  pij i*t. 

•  foltpiiun*  C«l  b 

•  hold  1»l*».hun*  6 "I 

•  Ou><  t>»l  Op*/ Jtlaf 


•  r.t‘n».**ft 

rrFeaeNC**: 

•  fun  jiu  p«»  aa  a* 

•  AC p  \\*[K).  P*r»  S'M.  bHb/7 

•  I-.  M>i AL  l.tMMJC  f’O  NU; 

■  ‘■hij  i  uni  I  %  t.*ol  | 

h  tH  tcqglrxJ  »h*  »V.  •*  *  u  ►  «'*U» 

U  i  L»*t  !■>’  ft  q—  l>p*’*- 

to  H  **>•(  juJ  M  lh«  *kt:i  f  actea 
M  port'  1  ol  IF*  U»«on 
a  fOUOW  IN*rBi/Ci  OsS  -- 
CON  T  TAK5  SHOBTC'JU 

pnEHEQUitfTE; 

•  |  tSdON  NO. 


6.1.3  Shipment  of  the  LA  Is  and 
SISs 


After  the  completion  of 
the  LAI  and  SIS,  you  must  insure 
that : 

•  The  SIS  is  sent  to  the 
development  contractor. 

»  The  LAI  is  reproduced  by 
the  school . 

•  Tobyhanna  is  sent  advance 
notice  of  shipment  (see  6.3-3)- 


6.2  DEVELOPING  AND  PACKAGING  HISTOR¬ 
ICAL  DATA  AMD  MATERIALS 


TEC  Managers  are  responsible 
for  preparing  and  shipping  histor¬ 
ical  files  for  each  TEC  lesson. 
This  section  contains  the  pro¬ 
cedures  for  this  responsibility. 


6  2.  1 _ I  temizing  Historical  Data 

and  Materials 


Historical  data  for  each 
TEC  lesson  must  be  collected 
and  shipped  to  the  Training 
Materiel  Support  Detachment 
Depot  at  Tobyhanna.  The 
list  of  items  that  must  be 
included  in  the  historical 
file  arc  given  below. 


.  j 


o  * 


L  i 
[ 
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AvVAiV/t  /wV/ 


ITtAlT ZIWG  HISTORICAL  VATA 

HISTORICAL  DATA 

1 .  NARRATION  SCRIPT. 

2.  SHOOTING  SCRIPT. 

3.  STORYBOARDS. 

If.  COPY  OF  35^  SLIDES  (MASTER). 

5.  COPY  OF  LAI  WITH  PRETEST/POSTTEST  AND  ANSWER  KEYS. 

6.  TYPED  COPV  OF  SIS. 

7.  COPY  OF  ADJUNCTIVE  MATERIALS  (IF  REQUIRED). 

8.  VALIDATION  COPY  (COMPLETE). 

0.  CORRECTED  COORDINATION  AND  CONTRACT  SUMMARY  SHEET  TO  REFLECT 
ACCURATELY  WHAT  THE  FINAL  PRODUCT  CONTAINED. 

10.  COPY  OF  APPROVED  TREATMENT  AMD  ANY  CHANGES.  ' 

11.  COST  DATA  (DEVELOPMENT)  XEROX  OF  PAID  DD  FORM  250. 

12.  WRITTEN  APPROVALS/DISAPPROVALS  RELATING  TO  TREATMENTS  (LDA's), 
SCRIPTS,  STORYBOARDS,  BOARD  ART,  35MM  SLIDES,  8MM  PRINTS,  AUDIO 
TAPES,  AND  OTHER  CORRESPONDENCE  PERTAINING  TO  GUIDANCE  ISSUED 
PERTINENT  TO  LESSON  DEVELOPMENT. 

13.  MILESTONE  SCHEDULE  OF  LESSON  DEVELOPMENT. 

l'l.  ANY  OTHER  HISTORICAL  DATA  NOT  LISTED  BUT  WHICH  SHOULD  BE  INCLUDED 
TO  ACCURATELY  CASE  THE  HISTORY  OF  THE  LESSON  IN  DETAIL. 

15.  VISUAL  DUMMIES  FOR  PRINTED  TEXT  LESSONS,  WORKBOOKS,  ETC. 

16.  DOCUMENTATION  TO  INCLUDE  LEGAL  CLEARANCES,  PHOTOGRAPHIC  CLEARANCES, 
COPYRIGHTS,  AND  NON-STANDARD  MUSIC  CLEARANCES. 
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The  reproduction 
contractor  is  responsible 
for  shipping  the  Board 
Art .  Board  Art  wi 1 1 
include  the  following 
i terns : 


•  Board  Art 

•  Shooting  Script. 

•  Original  Narration 
Script  with  Latest 
Changes  Annotated  . 

•  Original  Motion 
Sequences  ( i f 
appl i cabl e) . 

•  Work  Print  of 
Motion  Sequences 
(i f  appl i cable) . 

The  school  must 
provide  the  camera- 
ready  copy  for  printed 
text  lessons,  workbooks, 
LAIs,  and  adjunctive 
ma  t  e  r i a  1  . 


6.2.2  Itemized  Packing 

LLsJL-aad-Lls.  .Dis¬ 
tribution  (His¬ 
torical  Data) 


When  shipping  his¬ 
torical  files  to  Tobyhannn, 
schools  are  responsible  for 
preparing  five  (5)  copies 
of  the  itemized  packing 
list  (6.3.1).  Disposition 
will  be  as  shown  below. 
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ITEMIZED  PACKING  LIST  -  TEC  HISTORICAL  DATA 


1.  DISPOSITION  WILL  BE  AS  FOLLOWS: 

A.  ONE  COPY  PLACED  INSIDE  OF  SHIPPING  CONTAINER  WITH  MATERIALS. 

B.  ONE  COPY  PLACED  IN  AN  ENVELOPE  AND  AFFIXED  TO  THE  OUTISDE 
OF  THE  SHIPPING  CONTAINER. 

C.  ONE  COPY  SENT  TO  COMMANDER,  U.  S.  ARMY  TRAINING  SUPPORT 
CENTER,  ATTN:  ATTSC-TP-PD,  FORT  EUSTIS,  VIRGINIA  2360^. 

D.  ONE  COPY  SENT  TO  COMMANDER,  TOBYHANNA  ARMY  DEPOT,  ATTN: 
ATTSC-TP-TM  (TEC)  ,  TOBYHANNA  PENNSYLVANIA  I8'l66. 

E.  ONE  COPY  RETAINED  BY  SCHOOL  AS  A  FILE  COPY. 


2.  ALL  PACKAGES  BEING  SENT  TO  TOBYHANNA  ARMY  DEPOT  WILL  BE 
ADDRESSED  AS  FOLLOWS: 


COMMANDER 

TOBYHANNA  ARMY  DEPOT 

TRAINING  MATERIEL  SUPPORT  DETACHMENT 

ATTN:  ATTSC-TP-TM  (TEC) 

WAREHOUSE  3  BAY  3 
TOBYHANNA,  PENNSYLVANIA  18^66 


SHIPMENT  TO  TRAINING  MATERIEL  _ 
SUPPORT  DETACHMENT  (TOBYHANNA) 


TEC  lessons  and  adjunc¬ 
tive  material  go  to  Tobyhanna 
for  distribution.  As  the 
TEC  program  has  grown,  the 
amount  of  material  period¬ 
ically  received  by  Tobyhanna 
has  grown  enormously.  Conse¬ 
quently,  Tobyhanna  has  a 
problem  of  coordinating  and 
predicting  the  arrival  times 
of  lessons,  adjunct i ve  mater¬ 
ial,  LAIs,  and  historical 
files.  The  TEC  manager  can 
assist  Tobyhanna  by  giving 
them  advanced  notice  of 
anything  soon  to  be  shipped. 
By  using  the  Shipment  and 
Utilization  Report  for 
advanced  notice,  the  Toby¬ 
hanna  people  can  better 
prepare  for  efficient  stor¬ 
age  and  distribution.  This 
translates  into  getting  the 
TEC  lessons  to  the  field 
faster .  Until  Tobyhanna 
has  the  LAIs  and  adjunctive 
material  to  accompany  the 
TEC  lesson  (if  applicable), 
NOTHING  GOES  OUT! 


6.3.1  Overview  of  TEC  _ 

Lesson  Distribution 


The  process  of  pre¬ 
paring  for  distribution 
involves  the  following: 

•  The  school  sends  the 
SIS  to  the  development 
contractor. 


f  ZSi/K&k&W  ^ t  ~  :'-"r  JiofTr***-  wsesi  rxas?*  .m.-  wc  am  nr:  r 


»  me  btriuoi  reproduces  cne 
LA  I s  and  notifies  Tobyhanna 
well  in  advance  . 

•  The  school  sends  a  request 
to  AG  Publication  Center 
for  adjunctive  materials 
which  AG  subsequently 
ships  to  Tobyhanna. 

•  The  school  sends  a  letter 

of  distribution  instructions 
to  Tobyhanna  for  the  adjunc- 
t i ve  mater i al s  . 

•  Tobyhanna  receives  an  approved 
copy  of  the  answer  print  from 
the  project  engineer  (Orlando, 
Fla.)  . 

•  DCAS  sends  an  advance  copy 
of  DD  250  from  the  contrac¬ 
tor  s  i  te  . 

•  If  text  is  printed  in-house, 
TEC  manager  should  see 

that  Tobyhanna  gets  advanced 
notice  of  sh i pment  . 

The  flow  of  TEC  lesson 
materials  among  and  between  the 
schools,  ATSC/TF’D,  the  Develop¬ 
ment  Contractor,  the  Reproduc¬ 
tion  Contractor,  and  Tobyhanna 
is  given  below.  As  you  can 
see,  the  flow  of  TEC  materials 
coming  from  all  the  schools 
and  the  Reproduction  contrac¬ 
tors  for  all  TEC  lessons  can 
really  become  a  mess  without 
timely  communications. 


-AS  REQUIRED 


REPRODUCTION 

CONTRACTOR 


-REORDER 


MATERIALS 
FOR  PRODUC¬ 
TION  TRAIN¬ 
ING  ART 


DEVELOPMENT 

CONTRACTOR 


_BOARD 

ART 


TOBYHANNA 

ARMY 

DEPOT 


.ALL 

OTHER 

MATER¬ 

IALS 


AS 

■required" 


| 

ATSC/TPD j 


AS 

REQUIRED 


HISTOR¬ 

ICAL 

DATA 


AS 

REQUIRED 


PROPONENT 

SERVICE 

SCHOOL 


6.3.2  Palletizing  Procedures 


Each  pallet  should  con¬ 
tain  printed  matter  relating 
to  one  TEC  lesson  only.  When 
materials  from  several  les¬ 
sons  come  into  Tobyhanna 
on  one  pallet,  there  is  a 
great  pos  ; b i 1 i t y  that  a 
mix-up  wi 1  occur .  I t 
requires  the  sorting  out 


of  the  material  and  often 
the  repackaging  of  mater¬ 
ials. 

Heavy  or  bulky  contain¬ 
ers  should  be  metal  strapped 
or  bound  securely  in  a  man¬ 
ner  that  ensures  tV  cartons 
will  arrive  at  Tobyhanna 
undamaged . 

Packaging  I mt'iuctiuni . 
Separately  pack  any  adjunc¬ 
tive  materials,  including 
workbooks,  LAIs,  lesson 
texts,  errata  sheets,  change 
sheets,  DA  Forms,  and  Tech¬ 
nical  manuals.  These  items 
should  be  sorted  out  and 
packed  one  subject  per  box 
only. 

In  partial ly  filled 
containers  use  a  light¬ 
weight  filler  to  use  up 
the  empty  space.  AT  HO 
TIME  SHOULD  PART  OR  ALL  OF 
ANOTHER  LESSON  BE  USED  TO 
FILL  THE  EMPTY  SPACE. 


f  ladling  a > id  ldznti.{gj- 
i.ng  the.  Container .  Each 
cardboard  container  should 
be  clearly  marked  with  one 
inch  high  lettering  to 
i  ntli  cate: 

•  Lesson  Humber 

•  Quant i t  y 

•  Type  printed  matter 
(LAI ,  printed  text , 
workbook) 

Each  carton  should  be 
numbered  to  indicate  the 
amount  of  cartons  in  the 
shipment.  lor  example: 

Box  1  of  ;  Box  2  of  

Box  3  of 
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Place  an  i temi zed 
packing  list  of  the 
entire  shipment  in  Box 
N">.  I .  The  list  should 
include  the  following 
informat i on : 

•  Complete  or  partial 
shipment . 

•  Release  number  of 
the  lesson  , 

•  Subject  title  ^ 

•  Type  printed  matter 
(LAIs,  TMs,  \7orkbooks , 
etc. ) . 

•  Ouantity  of  contents, 

•  Total  carton  number 
in  the  shipment 


6.3-3  Advance  Notice  to 
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ADJUNCTIVE  MATERIALS  AND  Lf^SON  |»K|r. 


TO. 

DEPARTMENT  Of  1  Ml  ARMY 
Tr*knta|  lupp»t  Cf'W 
Mrt«M  Oodp^I 
ATTN:  ATTSC-TP-TM 
Pa,  1I4M 


THf  rOUOWINO  Tic  AOJUNCTfVI  MATERIAL!  ANO/OR  PHOG AAMrO  TEXT'S  MAW  MEN 
PROCESSED  THROUQH  TM*S  ICMOOL  fOH  ARRIVAL  VOUH  ACTIVITY  ON  Oft  R£K  **• _ 


As  we  pointed  out  in 
6.3*1 »  Tobyhanna  sorely 
needs  advanced  notice  of 
any  impending  shipment. 
Tobyhanna  personnel  sug¬ 
gest  you  always  use  the 
Shipment  and  Utilization 
Report  form  to  provide 
them  with  advanced  notice 
of  anything.  You  can  use 
the  explanation  section  if 
it  is  something  not  covered 
in  the  form  itself. 


THIS  SECTION  TO  U  COM¬ 
PLETED  SY  THE  TEC  0131  Al- 
BUHON  ACTIVITY  TOYV- 
HANNA  ARMY  DEPOT. 


THIS  MATERIAL  MAS 
RECEIVED  AT  TOWMAMNA 


□  SHIPMENT  RECEIVED  IN 
0000  CGNOITION 

□  SHIPMENT  ftfr'Cf IVED  IN 
UN3  A I  ISP  AC  TONY  CON¬ 
DITION. 
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6.4  REQUEST  FOR  ADJUNC¬ 
TIVE  MATERIAL  AND  ■ 
SHIPMENT 


I f  Army  pub  I i cat i ons 
(FMs,  TMs)  ore  required  for 
a  TEC  lesson,  then  you  req¬ 
uisition  them  from  AG  Pub¬ 
lication  Centers  at  St.  Louis 
and  Baltimore.  The  AG  Publi¬ 
cation  Centers  will  ship 
directly  to  Tobyhanna  pro¬ 
vided  you  follow  the  procedures 
given  below: 

Procedures 

•  Identify  adjunctive  ma¬ 
terials  required  for  a 
lesson. 

•  Prepare  for  the  appropri¬ 
ate  AG  Publication  Center 
the  fol 1 owi ng : 

a.  DA  Form  17  in  ac¬ 
cordance  wi th  the 
following  guidance: 

( 1  )  Block  1  Type  of 
Requisi t ion: 
Regular 

(2)  Block  2  Justi¬ 
fication  for 
Special  Requi¬ 
sition: 

NOTE:  "Account  Number"  and 
"Ship  To"  are  different  as 
approved  by  Letter,  ATTNG- 
TA-TEC,  U.S.  Army  Training 
Support  Center,  16  June  1976, 
subject:  Request  for  Excep¬ 
tion  for  Policy  at  AG  Publi¬ 
cation  Centers  with  1st  Inc, 
DAAG-PAD,  DA  TAGCEN,  7  July 
1976. 


..  TH*; 
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(3)  Block  6  Ship  To : 
Commander 
Training  Materiel 

Support  Detachment 
Warehouse  3,  Bay  3 
510-091 -6456-F  (TEC 
Lesson  No.  material 
for) 

Tobyhanna  Army  Depot 
Tobyhanna ,  PA  l  8^66 

(4)  Block  7  Requirements: 
One  requ i s  i  t ion  i  tem 
per  request  (j_.e_.  ,  if 
lesson  requires  a  TM 
and  a  blank  form, 
two  separate  DA  Form 

l 7 1 s  are  requ i red) . 

(5)  Block  8  Requester: 
Place  AV  phone  num¬ 
ber  of  a  person  to 
be  contacted  if  any 
questions  should 

ar i se  on  requested 
order. 

b.  Send  a  cover  letter  along 
with  its  inclosures  wi th 
each  DA  Form  17- 

Send  a  letter  to: 

Commander 

Training  Support  Center 
ATTN:  ATTSC-TP-TM 
Training  Materiel  Support 
Detachment 

Tobyhanna,  PA  18466 

and  a  courtesy  copy  to: 

Commander 

U.S.  Army  Training  Support 
Center 

ATTN:  ATTSC-TP-PD 
Fort  Eustis,  VA  23604 

providing  the  following  infor¬ 
mation: 

a.  Copies  of  all  separate 
DA  Form  17  act i ons . 

b.  Instructions  on  how 
to  distribute  ad  - 


tel 
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SUUJICT:  Request  for  Exception  to  Tolley  at  AC  Publication  Centers 


lltjDA  (DA-AC-TAD/I'.r.  tut) 
Fnrtostal  Building,  Uoun  CA033 
WASH  DC  20314 


1.  Reference,  FC  ICON  between  Mr.  Knne,  DA-AC-PAD,  inti  CPT  Brown. 
ATTh'C-TA-TEC,  4  Jon;  1076. 

2.  US  Amy  Service  Schools  periodically  have  requirements  for  large 
quantities  of  publications  or  pamphlets  for  use  as  adjunctive  naccrlols 
with  Training  Extension  Course  (TLC)  Lessons. 

3.  These  cialcrlals  have  been  requisitioned  through  AC  Publication 
Centers  at  St  Louis  a. id  Baiclnore  with  Instructions  to  ship  directly 
to  Tobyhanna  Amy  Depot  (TOAD)  where  all  TEC  lesson  materials  arc  con¬ 
sol  lJ.itcd  and  distributed  to  the  field.  Unfortunately,  some  catcrlals 
arc  being  shipped  bach  to  the  ordering  schools.  This  results  In  dupli¬ 
cation  of  elfort,  additional  cost  to  the  government,  and  delays  in 
receipt  ol  caterlals  at  TOAD. 

4.  Successful  shlp-cnts  have  been  handled  by  bypassing  the  tonputer 
and  requesting  special  hurdling  in  a  cepnr.iLc  t;eir.oranJu'.i  attached  to 
the  regular  requisition.  However,  AT,  310-10  precludes  honoring  "ship 
to"  requests  on  a  recurring  basis  without  on  exception  to  policy. 

5.  lYcnusc  of  the  recurring  need  for  service  schools  to  order  catcrlals 
an  a  "ship  to"  basis,  and  the  desire  to  eliminate  duplication  of  effort, 
request  an  exception  to  AS  310-10  for  schools  ordering  adjo-etlve 
rou-rl.ila  for  TlX  lessons. 

A.  Upon  approval  of  the  exception  to  policy,  the  Training  Support 
Center  (Provisional)  will  notify  all  schools  of  tho  change  and  the 
Tiuvtdurcs  to  be  fcllovoJ.  This  request  has  been  coordinated  with 
Mr.  lay  Kane,  DA  Publlca'ions. 

7.  The  US  Arc-y  Training  Support  Center  (Provisional) ,  Training  rrograos 
Directorate,  1EC  Division,  point  of  contact  Is  Cnptaln  Carlton  Drown, 
A’JTOWI  927-4121/412/,. 

TOP.  TUB  COMMANDER: 


It  At.  » 1 I.LACOME2 
CPT,  ACC 

Administrative  Officer 


SCHOOL  HEADING 


tUQJECT:  Social-  Handling  of  DA  Fo:m  17,  Pcqucst  for  Training 
Extension  Course  (TEC)  Program 


1.  reference.  Letter,  ATT.  -TA  TEC,  US  A my  Training  Support  Center, 
1C  June  1976,  subject:  Acquest  (or  Exception  to  Policy  at  AC 
Publication  Centers  with  1st  Indorsement ,  DAAC-PAO,  DA  TAGCCN,  e.uro 
.subject,  Inclosurc  1. 

2,  A 3  approved,  request  specie!  handling  on  the  attached  DA  Form  17, 
hcguJsition  for  Publications  and  Olauk  Forms,  Jticlosurc  2. 


junctive  materials  per 
lesson  (i.e.,  four  blank 
DA  form  2 ^ 0 A  1 s  per  TEC 
Lesson  No.  51 0-091 -6h 56 - F) 

c.  Provide  address  and  phone 
number  of  a  person  to  be 
contacted  at  school  so  as 
to  verify  receipt  of  your 
order  at  Tobyhanna. 

Set  up  a  suspense  file  allow¬ 
ing  seven  weeks  to  be  notified 
of  the  receipt  of  adjunctive 
materials  at  Tobyhanna.  If 
not  not i f i ed ,  call: 

1st  --  Tobyhanna,  AV 
2k7~c)l'Z7  (TFC) 

2nd  --  Appropriate  AC 

Publ i cat  ion  Center 


sicti.vrutu:  picck 
of  Requester 


Ba  1 1  i  more ,  MO  -■ 
AV  53/|-2 O': 5 

St.  Louis,  MO  -- 
AV  693-7361 


1  v:,m0  msgmm 


PETERMINING  ERRORS 


6.5  TEC  LESSON  ANNUAL  REV  I  Eli 
PROCEDURES 


The  responsibility  for 
annual  review  and  revisions 
of  TEC  lessons  belongs  to 
the  school  that  has  been 
designated  the  proponent 
agency  for  that  particular 
lesson  series.  As  TEC 
manager,  you  are  responsible 
for  insuring  that  the 
school : 

•  conducts  a  formal  annual 
review  of  each  lesson 
that  is  at  least  one- 
year  old  after  approval 
for  mass  production. 

•  maintains  records  of 
the  reviews  and  sub¬ 
mits  the  results  to 
ATSC/TPD. 


6.5.1  Determining  Sia- 
nificant  Errors 


During  the  annual 
review  of  a  TEC  lesson, 
particular  care  and  at¬ 
tention  should  be  paid 
to  changes  or  modifi¬ 
cations  in: 

•  training  tasks 

•  performance  standards 

•  training  objectives 
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.  w  /  n  a  '  WLT  V  *  <  ' 


LESSON  CHANGES 


•  job  requirements 

•  equipment 

•  doctr i ne  . 


6.5-2  Reconmendat ions  and 
Actions  for  Changes 
or  b'o-Ch a n ge s 


Based  on  the  lesson  review 
t lie  school  will  moke  a  formal 
recommendation  to  ATSC/TPD. 

If  no  changes  are  required, 
the  report  will  have  the  no¬ 
change  format.  If  the  review 
establishes  that  changes  are 
needed,  the  school  will  make  a 
formal  recommendation  to  that 
effect  along  with  the  extent 
and  method  of  revising  the 
1 esson . 


A  change  requiring  more 
than  on  errata  sheet  is  a 
serious  problem  in  terms  of 
time  and  money.  A  decision 
must  be  reached  as  to  the 
value  of  making  the  necessary 
corrections  or  deleting  the 
lesson  a  1  together . 
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6.6  PROCEDURES  FOR  A  SAFETY 
VIOLATION 


Once  you  are  notified 
of  a  possible  safety  vio¬ 
lation  in  a  TEC  lesson  that 
could  result  in  injury  to  a 
soldier  or  damage  to  Govern¬ 
ment  property,  you  must  do 
three  things: 

•  Immediately  notify  ATSC/ 
TPD  that  a  possible 
safety  violation  exists. 

•  Conduct  an  evaluation  to 
determine  whether  a  safe¬ 
ty  violation  indeed  exists 

•  Make  a  recommendation  to 
ATSC/TPD . 

ATSC/TPD  will  take  the 
necessary  actions  to  stop 
distribution  of  the  specific 
TEC  lesson  when  a  violation 
has  been  identified. 


5.7  SAFEGUARDING  DEFENSE 
INFORMATION 


C 1  ass i  f  ierl  TEC  lessons  are 
now  being  developed.  If  you  are 
going  to  develop  Classified  TEC, 
you  should: 

•  Contact  the  TEC  Classification 
Of f i cer . 

•  Obtain  a  copy  of  DCD  Direc¬ 
tives  and  Security  Regulations 
(DOD  500,  1-?.). 

•  Review  the  TEC  document  on 
classi f ied  lessons  . 


GLOSSARY 


Advanced  Individual  Training  (AIT). 


Annual  Review. 


Answer  Print. 


Army  Training  and  Evaluation 
Program  (ARTEP) . 


Army  Training  Extension  Course 
Program  (ATECP). 


Army  Training  Support  Center 
Training  Programs  Directorate 
Project  Officer  (ATSC-TPD  PO) . 


And i o  Only  Kit. 


Training  given  enlisted  personnel 
subsequent  to  completion  of  basic 
training,  so  as  to  render  them 
qualified  for  the  award  of  a  mili¬ 
tary  occupational  specialty. 

Review  of  each  TEC  lesson  on  the 
anniversary  of  its  approval  for 
mass  reproduction.  Review  is 
conducted  to  assure  lesson  currency. 

Audiovisual  preproduction  sample. 

It  consists  of  Super  8  color-corrected 
film,  loaded  in  a  cartridge,  and  a 
pulsed  audio  cassette. 

A  listing  of  training  and  evaluation 
outlines  that  contain  minimum  col¬ 
lective  training  objectives  and  gui¬ 
dance  pertaining  to  specific  missions. 
ARTF.Ps  can  serve  as  the  basis 
for  evaluation  by  which  the  level 
of  training  proficiency  of  a  particu¬ 
lar  unit  can  be  determined  and  future 
training  requirements  can  be  diagnosed 

One  of  the  three  Army-wide  training 
programs  managed  by  the  Training  Pro¬ 
grams  Directorate,  US  Army  Training 
Support  Center.  The  Chief,  ATECP  is 
responsible  for  centrally  managing  the 
planning,  evaluation,  development 
production,  distribution,  and  field 
implementation  of  all  Training 
Extension  Course  lesson  materials  and 
supporting  hardware. 

Coordinates  the  preparation  of  con¬ 
tractual  requirements  and  helps 
solve  problems  as  they  occur  at  all 
schools,  after  a  contract  has  been 
awarded. 

An  audio  tape  cassette  which  "talks" 
a  student  through  a  series  of  actions. 
Generally,  used  in  conjunction  with  a 
hands  on  or  ienta  t  i  on ,  j_._e.  ,  maintenanr 
procedures . 


GLOSSARY 


Audiovisual  Kit. 


Basic  Combat  Training  (BCT) . 


Basis  of  Issue  Plan  (801,  BOIP). 


Beseler  Cue/See. 


A  TEC  kit  consisting  of  a  Super  8mm 
continuous  loop  film  cartridge  with 
an  accompanying  audio  tape  cassette, 
pulsed  to  drive  the  film.  Both  film 
and  tape  are  compatible  to  the 
Beseler  Cue/See. 

Training  in  basic  military  subjects 
and  fundamentals  of  basic  infantry 
combat  given  to  newly  inducted  and 
enlistcu  Active  Army  and  Reserve 
components  personnel  without  prior 
mi  1 i ta ry  service  . 

Plan  for  the  distribution  of  TEC 
lessons  developed  by  ATSC  and  coordi¬ 
nated  with  the  proponent  service  school 
or  plan  for  the  distribution  of  TEC 
hardware  developed  by  ATSC. 

Audiovisual  device  used  for  viewing 
TEC  audiovisual  lessons. 


Commandant's  Contract.  Contract  between  Commander,  TRADOC,  and 

the  School  Commander  wi th  each 
service  school  portraying  resources 
provided  to  each  school  and  products 
expected  from  each  school  on  a  FV 
bas i s . 


Composite  Task  List. 


Cond i t i ons  . 


Contract . 


*  A  r  M  f  ft  *  .  _•  *■ — ^  ^  ‘  * 


A  listing  of  all  tasks  taught  by  all 
current  or  programmed  TEC  lesosns. 
Maintained  by  USATSC-TPD. 

Occurs  in  terminal  learning  objectives; 
describes  what  is  presented  to  the 
student  in  order  to  accomplish  the 
specified  action,  that  is,  it  describes 
the  important  aspects  of  the  performance 
envi  roriment . 

Formal  document  between  the  contractor 
and  the  government  that  specifies  ex¬ 
actly  what  and  how  many  TEC  lessons 
will  be  developed  during  a  particular 
time  period. 
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Contract  Developed  Lessons. 


Contracting  Officer's  Technical 
Representative  (COTR) . 


Contractually  Cancelled  Lessons/ 
Kit. 


Coordination  and  Contract 
Summary  Sheet  (CCSS) . 

Cr i teri a. 

Criterion-Referenced  Instruction 
(CRI)  . 

Criterion-Referenced  Test  (CRT). 
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Lessons  designed  and  developed  by 
a  contractor  wh i ch  follow  contrac¬ 
tual  specifications  and  are  eval¬ 
uated  for  technical  accuracy  and 
instructional  and  audiovisual  quality 
by  ATSC ,  schools,  PM  TRADE,  and  NT EC 
personnel  throughout  the  development 
cycle. 

Individual  who  is  normally  located 
at  the  site  of  a  development  or 
reproduction  contractor  to  assist 
ATSC,  schools,  P.M  TRADE,  and  the 
Contracting  Officer  in  expediting 
the  contractual  process. 

Lcsson/kit,  that  by  mutual  agree¬ 
ment  between  proponent  and  con¬ 
tractor,  is  cancelled  from  the  de¬ 
livery  schedule.  Contractor  is  paid 
for  work  accompl ished  through  the 
cancel lat ion . 

A  CCSS  is  completed  for  each  subject 
area  submitted  for  development.  The 
CCSS  outlines  the  scope  and  purpose 
of  lessons  being  developed  for  each 
subject  area,  target  audience,  lesson 
objectives,  acceptable  standards  of 
performance  and  criterion-referenced 
test  items.  It  accompanies  all  GFM 
or  references  provided  contractor  for 
development  of  a  lesson  series. 

States  how  wel 1  something  is  to  be 
performed . 

Instruction  wh i ch  is  designed  to  teach 
only  those  performances  which  are 
specified  as  critical  to  the  success¬ 
ful  accomplishment  of  a  defined  task. 

Measures  what  an  invividual  can  do  or 
knows,  compared  to  what  he  must  be  able 
to  do  or  must  know  in  order  to  success¬ 
fully  perform  a  task.  Here  an  in¬ 
dividual's  performance  is  compared 
to  external  criteria  or  performance 
standards  wh ‘ ch  are  derived  from  an 
analysis  of  what  is  required  to  do 
a  paritcular  task. 


GLOSSARY 


Cri  ter i a-Referenced  Test  I  terns 
(CRT!) . 

Critical  Task. 


Development  Phase. 


Duty . 


Effectiveness  Testing/Large 
Group  Tes  ti ng . 


Final  Draft. 


Fixed  Sample. 


Flow  Diagram. 


Front-end  Phase. 


Government  Furnished  Material 

(gtm)  . 


The  individual  measures  of  a  CRT. 


The  lowest  level  of  behavior  that 
describes  the  performance  of  a 
function  critical  to  the  job. 

Phase  of  TEC  lesson  development  pro¬ 
cess  that  includes  the  development 
of  initial  instructional  materials; 
conduct  of  individual,  small  group 
and  large  group  tests;  and  approval 
of  camera-ready  kits 

One  of  the  major  subdividions  of  work 
performed  by  one  individual.  One  or 
more  duties  constitute  a  job. 

Part  of  development  phase  which  deter¬ 
mines  whether  or  not  the  lesson  trains 
the  soldiers  for  whom  it  was  designed. 

Last  version  of  a  lesson  before  the 
production  of  the  master  material; 
j_.£.  ,  camera-ready  materials. 

In  testing  the  effectiveness  of  a  lesson, 
a  preset  number  of  soldiers  are  selected 
in  advance.  Decisions  are  based  on 
the  outcome  of  that  preset  sample. 

Used  in  TEC  contracts  to  visually  de¬ 
pict  actions/events  required  of  each 
participant  involved  in  developing 
TEC  lessons.  Frequently  accompanied 
by  a  narrative  description,  the  flow 
diagram  provides  specific  instructions 
and  precise  sequencing  for  TFC  develop¬ 
ers  . 

Phase  of  TEC  lesson  development  pro¬ 
cess  that  uses  the  job/task  analyses 
to  define  what  and  how  TEC  lesson 
subject  areas  should  be  described. 

Documents  and  equipment  supplied  to  a 
contractor  before  and  during  perfor¬ 
mance  under  that  contract. 


GLOSSARY 


Graphic  Arts  Guidance 
(GAGK)  . 

Historical  Package. 

I ndi v i dual  Trial . 

In-House  Development. 

Initial  Draft. 

Instructional  Systems 
(ISD)  . 

Job . 


Kit  Kit  available  from  ATSC-TPD  that 

specifi  es  standards  for  development 
of  visuals  in  audiovisual  and  printed 
text  lessons. 

Originals  or  copies  of  all  correspon¬ 
dence  and  attendant  training  materials 
for  a  specific  TEC  lesson  from  concept 
to  completion.  Master  historical 
data  for  all  lessons  are  maintained  at 
Tobyhanna  Army  Depot,  Pennsylvania. 

In  testing  the  effectiveness  of  a 
lesson,  this  is  the  initial  tryout  of 
lesson  materials  on  3  to  5  soldiers 
representative  of  the  target  population 

Lessons  designed  and  developed  within 
an  individual  school  using  school 
resources  or  contract  services  pro¬ 
cured  by  the  school  from  local 
civilian  community,  using  a  local 
installation  procurement  contracting 
office. 

First  complete  compilation  of  a  TEC 
lesson. 

Development  A  five  volume  text  that  presents  a 

i  illy  documented,  detailed,  systematic 
approach  to  instructional  development. 

The  duties  and  tasks  preformed  by 
a  single  worker  constitute  his  job. 

If  identical  duties  and  tasks  are  per¬ 
formed  by  several  individuals,  they 
all  hold  the  same  job.  The  job  is 
the  basic  unit  used  in  carrying  out 
the  personnel  actions  of  selection, 
training,  classification,  and  assign¬ 
ment  . 

One  of  the  four  types  of  TEC  lsssons. 
Consists  normally  of  operating  in¬ 
structions  for  simple  equipment  or 
"how  to"  instructions  to  complete 
a  process  . 


Job  Performance  Aid  (JPA) . 


GLOSS m 


Job/Task  Ana lys i s . 


Job  Training  Package. 


Kit. 


Kit  Design  Approach  (KDA). 

Large  Group  Testing. 
Lesson. 

Lesson  Administrative 
Instructi  on  (LAI ) . 


k»-  mm 


The  basic  method  used  to  obtain  a  de¬ 
tailed  listings  of  duties,  tasks, 
and  elements  necessary  to  perform  a 
clearly  defined,  specific  job  or 
task,  involving  observations  of 
workers  and  conversations  w i  tit  those 
who  know  the  job,  in  order  to  describe 
in  detail  the  work  involved,  includ¬ 
ing  the  classes  of  behaviors,  condi¬ 
tions  of  performance,  and  degrees  of 
proficiency  required. 

A  totally  designed  group  of  training 
materials  in  a  self-contained,  ex¬ 
portable,  primarily  TEC  configuration. 
The  package  is  designed  to  train  and 
evaluate  all  skills  associated  wi th 
a  specified  job,  duty  position,  skill 
level  or  HOS. 

A  kit  is  the  self-contained  instruction 
material  developed,  reproduced  and  pack¬ 
aged  for  distribution  to  soldiers  in 
the  field.  A  kit  will  be  in  an  audio¬ 
visual,  printed  text  or  audio  only 
format.  Closely  related  kits,  those 
dealing  with  the  same  subject  ares,  will 
constitute  a  lesson. 

Prepared  by  contractor  and  contains 
the  description  of  the  kit,  how  the 
kit  will  be  developed,  outline  of 
size  and  content,  outline  of  adminis¬ 
trative  requirements  to  support  the 
kit,  and  provisions  for  design  changes. 

(SEE  Effectiveness  Testing). 

A  lesson  is  the  instructional  material 
within  one  (l)  subject  area.  A  lesson 
may  be  composed  of  one  or  several 
closely  related  kits. 

Accompanies  each  TEC  lesson  and  pro¬ 
vides  detailed  information  on  the 
lesson.  The  LAI  includes  both  a  pre¬ 
test  and  a  posttest. 
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Lesson  Content  Analysis 
Report  (LCAR) . 


Mas  ter  Kit. 


Master  Mechanicals. 


Mas  ters . 


Master  Tape. 


Naval  Training  Equipment  Center 
Contracting  Officer's  Technical 
Representative  (NTEC  COTR) . 


Contractor  developed  outline  of  general 
approach  for  constructing  instructional 
material  to  support  a  lesson  specified 
by  a  proponent.  Contains  an  appraisal  of 
the  adequacy  of  GFM. 

Kit  containing  all  the  master  materials, 
J_.£.  ,  camera-ready  copies,  which  are 
constructed  from  an  approved  final 
draft . 

Final  copy  of  a  printed  TEC  lesson  wh  i  ch 
is  camera-ready  for  printing. 

Soldiers  who  are  experts  at  one  particu¬ 
lar  job  or  task. 

Final  recording  of  an  audio  only  lesson 
or  the  audio  portion  of  an  audiovisual 
lesson  ready  for  mass  reproduction. 

Placed  with  reproduction  contractor  for 
quality  control  and  to  coordinate 
between  the  school  and  the  reproduction 
contractor . 


Naval  Training  Equipment  Center 
Project  Engineer  (NTEC  PE). 


Insures  quality  control  through  inspec¬ 
tion  of  products  for  compliance  with 
the  technical  standards  required  by  the 
contract,  and  is  directly  responsible 
to  PM  TRADE. 


Non- Mas  ters . 


Soldiers  who  are  new  to  a  job  or  task 
and  have  no  expertise  in  that  job  or 
task . 


Objectives.  Describes  precisely  what  the  personnel 

undergoing  instruction  must  be  able  to 
do  at  the  end  of  that  training.  A  pro¬ 
perly  structured  training  objective 
contains  three  elements:  (l)  Task 
to  be  accomplished  stated  in  perfor¬ 
mance  terms  using  action  verbs,  (2) 

Condi t i ons  under  which  the  task  is 
to  be  accomplished,  and  (3)  S tandards 
of  acceptable  performance. 


GLOSSARY 


Performance-oriented  Training. 


Performance  Test. 


Posttest. 


Pre-award  Phase. 


Preproduction  Sample. 


Pretest. 


Printed  Text  Ki t . 


Project  Manager  for  Training 
Devices,  Acquisition 
Director  (PM  TRADE  AD). 


Emphasizes  the  knowledges  and  skills 
that  are  needed  to  perform  a  task  or 
job . 

The  absolute  standard  by  wh i ch  the 
performance  of  a  skill  is  measured.  It 
lists  the  exact  steps  a  person  must 
follow  in  performing  the  skills  being 
tested.  The  tests  are  prepared  in  terms 
of  the  specific  task  to  be  performed, 
conditions  under  which  it  will  be 
performed  and  the  absolute  standards 
for  acceptable  performance. 

A  test  administered  after  the  comple¬ 
tion  of  instruction  to  assess  whether 
a  student  has  mastered  the  objectives 
of  the  course  or  unit. 

Phase  of  TEC  lesson  development  process 
during  which  the  contract  is  written. 

Also  called  the  Front-end  Phase. 

Sample  product  of  a  TEC  kit  submitted 
to  the  proponent  school  and  PM  TRADE 
for  approval  prior  to  the  mass  reproduction 
run.  In  the  audiovisual  medium  the  sam¬ 
ple  is  an  answer  print.  In  audio  only 
the  sample  consists  c*-  a  duplicate  of  the 
master  tape  in  an  appropriate  tape 
cassette.  In  printed  text  the  sample 
consists  of  proof  prints  of  master 
mechan i cal s  . 

Administered  prior  to  instruction  to 
determine  how  much  the  student  already 
knows . 

A  printed  TEC  lesson.  Used  when  this 
medium  is  educationally  sounder  than 
others . 

Monitors  contract  performance,  and 
directs  and  coordinates  the  develop¬ 
ment  and  implementation  of  remedial 
actions  when  problems  occur.  Does 
not  normally  interact  directly  with 
the  school . 
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Project  Manager  for  Training 
Devices,  Contracting  Officer's 
Technical  Representative 
(PH  TRADE  COTR)  . 


Reliability. 


Reproduction  Phase. 


Response  Time. 


Scratch  Tape. 


Script. 


Sequential  Testing. 


Skill  Qualification  Test  (SQT) . 


Sma 1  I  Group  Trial . 


Monitors  and  facilitates  the  orderly 
progress  of  the  contract  while 
residing  at  the  contractor's  place 
of  work.  Serves  as  a  direct  point  of 
contact  between  the  school  and  the 
contractor . 

The  consistency  wi th  which  a  test 
measures  the  amount  of  student 
achievement. 

Phase  of  TFC  lesson  development  pro¬ 
cess  which  covers  the  reproduction 
and  distribution  of  approved  TEC 
lessons. 

The  time  that  the  student  actively 
participates  in  a  lesson. 

Initial  narrative  recorded  on  tape 
for  review,  correction,  improvement, 
and  approval  for  finished  narrative. 

A  detailed  plan  of  all  that  constitutes 
an  audiovisual  or  an  audio  only  lesson. 

A  method  of  testing  which  allows  the  ran¬ 
dom  selection  of  a  single  sample  at  a 
time,  with  the  pass/fail  result  of  a 
criterion  test  plotted  on  a  control 
graph.  The  graph  is  constructed  to  ensue 
that  acceptance  or  rejection  of  instruc¬ 
tional  materials  is  done  with  a  known 
probability  of  error. 

A  test  to  improve  the  combat  effective¬ 
ness  of  Army  units  by  getting  soldiers 
to  do  a  better  job.  Measures  how  well 
a  soldier  can  do  the  tasks  of  his 
assigned  job.  Measures  performance, 
not  knowledge. 

In  testing  the  effectiveness  of  a 
lesson,  this  is  the  second  tryout  (which 
is  optional)  of  lesson  materials  on  a 
group  of  6  to  10  soldiers  representative 
of  the  target  population. 
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Soldier's  Manual  (SM)  . 


Sound/S  1 i de  Kit. 


S  tanda  rds . 

Stimulus  Time. 

Student  Instruction  Sheet  (SIS). 

Subject  Matter  Expert. 


Target  Audience/Population. 

Task  Analysis. 

Training  Extension  Course  (TEC)  . 


Training  Extension  Course  (TEC) 
Manager . 


Manuals  published  by  proponents 
which  contain  all  critical  tasks  for 
a  specific  MOS ,  normally  organized  by 
ski  1 1  level . 

35mm  slides  and  a  draft  narrative 
tape  to  represent  v/hat  the  finished 
audiovisual  lesson  will  be.  Used  in 
the  review/approvol  cycle. 

Occurs  in  terminal  learning  objectives; 
describes  the  criterion  or  standard  of 
performance  which  must  be  attained. 

The  time  the  student  spends  viewing  or 
listening  to  the  TEC  lesson  materials. 

Printed  instructions  accompanying 
each  TEC  kit  to  assist  students  in 
use  of  the  kit. 

A  soldier  who  has  professional  skill 
in  the  performance  of  some  job  and  v/ho 
is  consulted  by  an  instructional 
designer  during  the  TEC  lesson  develop¬ 
ment  process. 

The  pool  of  potential  entrants  to 
training  for  which  instructional 
materials  are  designed  and  tried  out. 

(SEE  Job/Task  Analysis). 

Validated,  interactive,  performance 
oriented,  exportable  training  materials 
developed  by  contract  or  in-house  and 
fielded  under  the  sole  direction  of  the 
US  Army  Training  Support  Center  (ATSC) . 
TEC  materials  are  multimedia  and  are 
designed  for  individual  self-paced  or 
small  group  study.  TEC  is  designed  to 
assist  the  field  commander  in  maintain¬ 
ing  the  individual  skills  of  his  soldiers 

Individual  at  each  school  v/ho  is 
responsible  for  the  development  of 
TEC  lessons  that  cover  the  sub jeet 
areas  for  which  the  school  is 
respons ib 1 e . 


GLOSSARY 


Training  Task  Analysis. 


Val i dation. 


Visual  Dummy. 


Takes  tasks  selected  for  training 
and  structures  them  in  ways  that 
help  the  soldier  master  the  perform¬ 
ance  of  those  tasks.  Often  approxi¬ 
mates  the  job/task  analysis. 

Testing  instructional  materials  after 
course  development  to  ensure  that  the 
materials  are  effective  and  the  stu¬ 
dents  are  mastering  the  learning 
objecti ves . 

A  stage  in  the  development  of  printed 
text  lessons  that  illustrates  how  the 
narration  and  visuals  will  appear  in 
the  Final  draft. 
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ACROUZMS 


AD 

Acquisition  Director 

ARI 

Army  Research  Institute  for  the  Behavioral 
and  Social  Sciences 

ATSC 

Army  Training  Support  Center 

ATECP 

Army  Training  Extension  Course  Program 

A  V 

Audiovisual 

AO 

Audio  Only 

ARTEP 

Army  Training  and  Evaluation  Program 

ATB 

Army  Training  Board  (previously  CATB) 

BCT 

Basic  Combat  Training 

BER 

Budget  Execution  Review 

BMG 

Budget  Manpower  Guidance 

CA 

Contractor  Assisted 

CAI 

Computer  Aided  Instruction 

CATB 

Combat  Arms  Training  Board 

CC5S 

Coordination  and  Contract  Summary  Sheet 

CONUS 

Continental  United  States 

COTR 

Contracting  Officer's  Technical  Representative 

CRI 

C r i ter i on -Referenced  Instruction 

CRT 

Criterion-Referenced  Test 

COB 

Close  of  Business 

DARCOM 

U.  S.  Army  Materiel  Development  and  Readiness 
Command 

DAVIS 

Defense  Audiovisual  Information  System 
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ACRONYMS 


DCAS 

DCSRM 

DD 

DUD 

DOE 

DTD 

EOE 

EPMS 

FM 

FY 

GAGK 

GFM 

IH 

ISD 

JPA 

JPM 

JTP 

KDA 

LADA 

LAI 

LCA 


Defense  Contract  Administrative  Services 

Deputy  Chief  of  Staff  Resource  Management 

Department  of  Defense  (Used  on  forms,  e^.q. 
DD  &33-*0 

Department  of  Defense 
Directorate  of  Evaluation 
Directorate  of  Training  Development 

Element  of  Expense 

Enlisted  Personnel  Management  System 

Field  Manual 
Fiscal  Year 

Graphic  Arts  Guidance  Kit 
Government  Furnished  Materials 

I n-Uouse 

Instructional  Systems  Development 

Job  Performance  Aid 
Job  Performance  Measure 
Job  Training  Package 

Kit  Design  Approach 

Lesson  Analysis  Design  Approach 
Lesson  Administrative  Instructions 
Lesson  Content  Analysis 


ACRONYMS 

MOS 

Military  Occupational  Specialty 

N/A 

Not  Appl i cab  1  e 

NCO 

Non-Commissioned  Officer 

NLT 

No  Later  Than 

NTEC 

Naval  Training  Equipment  Center 

OJT 

On- Job  Training 

PE 

Project  Engineer 

PM  Trade 

Project  Manager  for  Training  Devices 

PO 

Project  Officer 

POC 

Point(s)  of  Contact 

PT 

Printed  Text 

RCS  ATTNG-SS 

Report  Control  Symbol  for  Quarterly 
TEC  Product  Requirement 

RFP 

Request  for  Proposal (s) 

SIS 

Student  Instruction  Sheet 

SM 

Soldier's  Manual 

SME 

Subject  Matter  Expert 

SQT 

Skill  Qualification  Test 

TC 

Training  C i rcul ar 

TDI 

Training  Developments  Institute 

TDY 

Temporary  Duty 

ACRONVm 


TEC 

Training  Extension  Course 

TM 

Technical  Manual 

TO 

Training  Objective 

TPD 

Training  Programs  Directorate 

TPADOC 

U.S.  Army  Training  and  Doctrine  Command 

USACATB 

U.S.  Army  Combat  Arms  Training  Board 

USATSC-TPD 


U.S.  Army  Training  Support  Center-Training 
Programs  Directorate 


